-- Logs begin at Fri 2022-08-19 15:33:05 UTC, end at Fri 2022-08-19 16:54:18 UTC. -- Aug 19 16:16:28.978768 dv-cinder-831247-23-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 16:16:28.987296 dv-cinder-831247-23-smb devstack@keystone.service[81793]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 16:16:28.989913 dv-cinder-831247-23-smb devstack@keystone.service[81793]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 16:16:28 2022] *** Aug 19 16:16:28.990057 dv-cinder-831247-23-smb devstack@keystone.service[81793]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 16:16:28.990172 dv-cinder-831247-23-smb devstack@keystone.service[81793]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 16:16:28.990277 dv-cinder-831247-23-smb devstack@keystone.service[81793]: nodename: dv-cinder-831247-23-smb Aug 19 16:16:28.990373 dv-cinder-831247-23-smb devstack@keystone.service[81793]: machine: x86_64 Aug 19 16:16:28.990479 dv-cinder-831247-23-smb devstack@keystone.service[81793]: clock source: unix Aug 19 16:16:28.990579 dv-cinder-831247-23-smb devstack@keystone.service[81793]: pcre jit disabled Aug 19 16:16:28.990678 dv-cinder-831247-23-smb devstack@keystone.service[81793]: detected number of CPU cores: 4 Aug 19 16:16:28.990782 dv-cinder-831247-23-smb devstack@keystone.service[81793]: current working directory: / Aug 19 16:16:28.990883 dv-cinder-831247-23-smb devstack@keystone.service[81793]: detected binary path: /usr/bin/uwsgi-core Aug 19 16:16:28.990974 dv-cinder-831247-23-smb devstack@keystone.service[81793]: your processes number limit is 47680 Aug 19 16:16:28.991064 dv-cinder-831247-23-smb devstack@keystone.service[81793]: your memory page size is 4096 bytes Aug 19 16:16:28.991159 dv-cinder-831247-23-smb devstack@keystone.service[81793]: detected max file descriptor number: 2048 Aug 19 16:16:28.991284 dv-cinder-831247-23-smb devstack@keystone.service[81793]: lock engine: pthread robust mutexes Aug 19 16:16:28.991447 dv-cinder-831247-23-smb devstack@keystone.service[81793]: thunder lock: enabled Aug 19 16:16:28.991771 dv-cinder-831247-23-smb devstack@keystone.service[81793]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 16:16:28.991847 dv-cinder-831247-23-smb devstack@keystone.service[81793]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 16:16:29.031511 dv-cinder-831247-23-smb devstack@keystone.service[81793]: Python main interpreter initialized at 0x559a421f89c0 Aug 19 16:16:29.031511 dv-cinder-831247-23-smb devstack@keystone.service[81793]: python threads support enabled Aug 19 16:16:29.031511 dv-cinder-831247-23-smb devstack@keystone.service[81793]: your server socket listen backlog is limited to 100 connections Aug 19 16:16:29.031511 dv-cinder-831247-23-smb devstack@keystone.service[81793]: your mercy for graceful operations on workers is 90 seconds Aug 19 16:16:29.031859 dv-cinder-831247-23-smb devstack@keystone.service[81793]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 16:16:29.031934 dv-cinder-831247-23-smb devstack@keystone.service[81793]: *** Operational MODE: preforking *** Aug 19 16:16:29.032180 dv-cinder-831247-23-smb devstack@keystone.service[81793]: *** uWSGI is running in multiple interpreter mode *** Aug 19 16:16:29.032180 dv-cinder-831247-23-smb devstack@keystone.service[81793]: spawned uWSGI master process (pid: 81793) Aug 19 16:16:29.032388 dv-cinder-831247-23-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 19 16:16:29.033473 dv-cinder-831247-23-smb devstack@keystone.service[81793]: spawned uWSGI worker 1 (pid: 81804, cores: 1) Aug 19 16:16:29.033473 dv-cinder-831247-23-smb devstack@keystone.service[81793]: spawned uWSGI worker 2 (pid: 81805, cores: 1) Aug 19 16:16:29.033473 dv-cinder-831247-23-smb devstack@keystone.service[81793]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 16:16:33.404961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:16:33.404961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: from cryptography.utils import int_from_bytes Aug 19 16:16:33.406544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:16:33.406544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: from cryptography.utils import int_from_bytes Aug 19 16:16:33.407034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:16:33.407034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: from cryptography.utils import int_from_bytes Aug 19 16:16:33.407553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:16:33.407553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: from cryptography.utils import int_from_bytes Aug 19 16:16:33.462900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:16:33.463093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:16:33.463179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:16:33.463272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] command line args: [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:16:33.463351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:16:33.463564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:16:33.463647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] command line args: [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:16:33.463752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ================================================================================ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:16:33.463867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:16:33.464054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ================================================================================ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:16:33.464147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] admin_token = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] config_dir = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] admin_token = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] config_dir = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] config_source = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] debug = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.464949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] config_source = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] debug = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.465911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_config_append = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_config_append = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.466906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_dir = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_dir = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.467642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.468196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.468388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.468901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.468977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.469946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.470956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] publish_errors = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.471937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] publish_errors = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.472884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] standard_threads = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473281 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] standard_threads = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] use_journal = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.473961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] use_json = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] use_journal = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] use_stderr = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] use_json = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] use_syslog = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] use_stderr = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] use_syslog = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:16:33.474916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.475947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.476854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.477881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.478992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.479514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.485863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.486957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.487995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.488992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.489949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.490961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.491985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.492966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.493896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.494983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.495940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.496958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.497993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.498914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.499926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.external = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.external = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.password = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.500934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] auth.token = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.password = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] auth.token = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.501997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502751 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.502995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.503850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.504845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.505890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.506888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.507892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.508883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.509891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.510987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.511841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.512971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.513998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.514075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.514248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.514332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.515974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.516967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.517986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.518925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.519917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.520909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.521872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.522998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.523761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.527983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.528975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.529996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.530756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.531940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.532954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.533887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] role.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.534869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] role.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] role.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] role.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.535876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.536899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.537873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.538846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.539827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.540835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.541974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.542959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.543974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.544951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.545982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.546957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.547925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.548946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.549976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.550955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.551931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.552736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:16:33.552835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:16:33.553010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:16:33.582736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.582967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.583194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.583279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.583510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.583765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.591722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.592332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.621893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.621893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.622070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.622070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.679627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.679782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.740457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.740692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.740806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.740988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.913709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.913874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.913946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.914671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.935406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.935663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.935891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.936875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.937046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.937325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.937606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.938087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.938314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.948401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.948846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.961360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.961594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.961815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.961897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81805) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.962903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.963124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 16:16:33.980046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.980259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 16:16:33.980514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.980604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.980730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 16:16:33.980818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 16:16:33.981056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.981139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.981266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 16:16:33.981346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.981553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.981821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.981902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.982086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.982342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.982690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.992258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.992543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.992792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.992877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.993079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.993178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.993358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:33.993649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.000068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.001097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.002951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.003242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.003553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.003844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.004159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.004925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.005876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.006042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.006436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.006734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.007014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.028691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.029928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.030686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.031162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.031959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.034775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.036074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.036366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.036657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.036990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.037281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.037572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.043041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.043355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.044035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.044340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.048134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.048431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.048716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.049283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.049930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.050113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.050195 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.050442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.050722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.050998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.067558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.067843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.068646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.068937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.071770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.072911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.074969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.075273 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.076171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.076479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.086409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.086499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.086665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.086825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.086916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.086916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.087064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.087275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.087581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.087878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.088004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.088313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.088603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.088909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.089177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.089463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.104363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.104641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.104913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.105179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.106090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.106383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.106658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.106934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.112152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.120819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.120908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.120984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.121201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.121498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.121498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.129240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.129529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.129816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.130104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.130394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.130678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.130972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.131130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.131427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.131737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.132025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.132327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.132645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.132929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.147048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.148908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.150199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.152010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.153116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.154557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.154929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.156910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.157023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.157200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.157498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.158496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.158787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.159093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.164026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.165437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.165629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.167136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.168496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.168801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.169094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.169379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.170106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.170407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.170732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.171145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.177480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.177772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.180933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.181022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.181022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.181022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.185010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81805) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.185301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.185590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.185872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.186151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.186456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.186648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 16:16:34.186793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.186922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.187049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.187214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.187342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.187523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.187899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.188905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81805) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.189000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.189199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.189554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.189786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.190068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.190354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.190631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 16:16:34.223964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a421f89c0 pid: 81805 (default app) Aug 19 16:16:34.225951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a421f89c0 pid: 81804 (default app) Aug 19 16:16:34.227389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4850da4-4aee-4a37-9a4d-610d0832240a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:34.227704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4850da4-4aee-4a37-9a4d-610d0832240a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:34.227984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4850da4-4aee-4a37-9a4d-610d0832240a None None] PATH_INFO: `/v3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:34.232256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Fri Aug 19 16:16:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:41.789913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:41.790384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:41.790384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:41.794670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:16:41.800341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:41.800726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:41.800926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:41.873596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: INFO dbcounter [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] Registered counter for database keystone Aug 19 16:16:41.895047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG oslo_db.sqlalchemy.engines [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:16:41.901235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writer thread running {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:16:42.081872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG passlib.handlers.bcrypt [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81805) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 16:16:42.082294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG passlib.handlers.bcrypt [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81805) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 16:16:42.136282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:42.137895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:42.267953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 16:16:42.753067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:42.823288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: INFO dbcounter [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] Registered counter for database keystone Aug 19 16:16:42.842630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG oslo_db.sqlalchemy.engines [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:16:42.849516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writer thread running {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:16:42.973693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7cd10-1eb8-4694-983a-ca7a29168479 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:42.978001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:42.978633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:42.978912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:42.979186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:42.988130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:43.039521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 16:16:43.039834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75459b22-b96f-4510-8483-b480add0dc69 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:43.050228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Aug 19 16:16:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:16:43.056208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:43.070674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542987e-ccb4-4882-9274-f9cd8be08233 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:43.075138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:43.076248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:43.076526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:43.076794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] PATH_INFO: `/v3/projects/d82f5f177bcb4be880a31087244a29b4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:43.078933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d82f5f177bcb4be880a31087244a29b4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:43.132607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 16:16:43.132956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49b317-2985-4bc4-bb94-f75b88df17d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:43.137621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Aug 19 16:16:43 2022] GET /identity/v3/projects/d82f5f177bcb4be880a31087244a29b4 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:45.011005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d597e-eaab-4dad-84a1-a9ab239a21fb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:45.011541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d597e-eaab-4dad-84a1-a9ab239a21fb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:45.011625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d597e-eaab-4dad-84a1-a9ab239a21fb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:45.015728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:45.021030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:45.021463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:45.021576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:45.041639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:45.043153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:45.051632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 16:16:45.319569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d597e-eaab-4dad-84a1-a9ab239a21fb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:45.332263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d597e-eaab-4dad-84a1-a9ab239a21fb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:45.336447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:45.337049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:45.337336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:45.337615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:45.346370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:45.348198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2c47c-67e7-4c80-8de8-ede984d85dfa admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:45.357683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Aug 19 16:16:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:16:45.362991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:45.372027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a388c8-6782-4c39-9dca-bb1d4712d40b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:45.376567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:45.377195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:45.377478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:45.377754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:45.379064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:45.380934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a33ab-bcf3-4340-8524-4fccaa12f2d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:45.382448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Aug 19 16:16:45 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:47.365183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514bfe0-a3b7-482c-95a6-0219847a27b3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.365687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514bfe0-a3b7-482c-95a6-0219847a27b3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.365777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514bfe0-a3b7-482c-95a6-0219847a27b3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.367051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:16:47.372446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.372883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.373004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.373257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8143-84b4-4ed9-ab03-123dfadff558 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.373543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8143-84b4-4ed9-ab03-123dfadff558 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.373816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8143-84b4-4ed9-ab03-123dfadff558 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.375018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:16:47.380064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.380342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.381479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.391370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:47.392626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:47.422757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG passlib.handlers.bcrypt [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81804) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 16:16:47.423185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG passlib.handlers.bcrypt [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81804) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 16:16:47.469738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:47.471334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:47.472633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:47.568412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:16:47.740564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:47.764340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:47.839938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:47.844472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c897d8-88a0-43cc-aad2-bfe7615195fe None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:47.878997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:47.879643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.879928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.880205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.942762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635c230-a55f-4f23-8454-c5d4eecc92de None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:47.945037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:47.946676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:47.948192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:47.971825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:47.979559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:47.987534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:47.987534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:47.987534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:47.993623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:16:48.002856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:16:48.003943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:16:48.004759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:16:48.010078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.046292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:16:48.051975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.110619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9441aa-6680-4357-8b97-5780eb82c5ed None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.143629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.144234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.144510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.144785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.145446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:48.145746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.147188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.148688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5973b-bbac-4c81-9b37-3d3b48ebe972 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.158737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:48.164336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.172038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:48.184029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.184729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.185018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.185297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.191201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:48.196441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.197923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:16:48.216683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:16:48.222777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:16:48.223586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:16:48.223586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:16:48.223586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:16:48.223586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:16:48.223921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.262851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45aff-21b8-4db9-b78e-04974eb4687b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.295682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.296331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.296616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.296888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.298356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.299838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.301563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:48.306937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.324641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e527df-f809-4b05-94de-daa691b0fce3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.361262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.361878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.362163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.362438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.363087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:48.363394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.364873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.382406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:48.404032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:48.411666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22421-30ee-4c29-bf6f-bd046e0ddca9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.449744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.450397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.450678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.450953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.452235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.454002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5b740-4ad0-4270-ae96-eddb52148673 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.455634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:48.461674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:48.497998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:48.566904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4ba8-a1e1-4c08-a54d-aba4ebbb98de None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:48.601283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:48.601980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:48.602266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:48.603376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:48.603376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.domain.id=default, user.id=caf63f3d1ac541d4a3b8a169250bb417) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:48.603740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:48.605233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c496-5b68-4f68-a896-517fbef0a762 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:48.614117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Fri Aug 19 16:16:48 2022] GET /identity/v3/role_assignments?user.id=caf63f3d1ac541d4a3b8a169250bb417&scope.domain.id=default&role.id=80a461100b904c7e8f047066bc70bf3b => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:50.569071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19b4a-22cf-40e3-8345-09216343cc80 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.569598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19b4a-22cf-40e3-8345-09216343cc80 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.569673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19b4a-22cf-40e3-8345-09216343cc80 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.571323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:50.593860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452d8-6c8b-4f91-8fda-155baa544419 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.594339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452d8-6c8b-4f91-8fda-155baa544419 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.594428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452d8-6c8b-4f91-8fda-155baa544419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.616188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4da452d8-6c8b-4f91-8fda-155baa544419 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:50.617298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4da452d8-6c8b-4f91-8fda-155baa544419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:50.670232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9641-0812-47ec-b8d0-b59909a7ef8f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.670619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9641-0812-47ec-b8d0-b59909a7ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.671564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9641-0812-47ec-b8d0-b59909a7ef8f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.673583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 13/23] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:16:50.678997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1fd7-38c4-4627-8f01-e1ea57bc88f3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.679413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1fd7-38c4-4627-8f01-e1ea57bc88f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.679856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1fd7-38c4-4627-8f01-e1ea57bc88f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.720694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73fa1fd7-38c4-4627-8f01-e1ea57bc88f3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:50.721888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73fa1fd7-38c4-4627-8f01-e1ea57bc88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:50.775950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:50.839924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 14/25] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:16:50.876301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef6cb-ac17-473c-869b-6bfd773c448c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.876576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef6cb-ac17-473c-869b-6bfd773c448c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.876791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef6cb-ac17-473c-869b-6bfd773c448c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.878405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 12/26] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:50.883541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:50.883839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:50.884113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:50.912151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:50.913386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:50.999221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:51.239177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef6cb-ac17-473c-869b-6bfd773c448c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:51.268579 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:51.273344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:51.310437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:51.438087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef6cb-ac17-473c-869b-6bfd773c448c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:51.469374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2e8c-f7e1-4a36-a0bc-0db1457ca66a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:51.477425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:51.478246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.478670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.479107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.491331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-93f99ef3-777d-40e8-8baf-cb67bff08e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:16:51.497990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:16:51.498914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:51.500169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:16:51.502425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 13/28] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:16:51.508593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119030d1-9fe4-4013-b584-fd639995bf2d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.508593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119030d1-9fe4-4013-b584-fd639995bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.508593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119030d1-9fe4-4013-b584-fd639995bf2d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.508593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 14/29] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:51.508593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119030d1-9fe4-4013-b584-fd639995bf2d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:51.512110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:51.513232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.513509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.513781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.534140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:51.535732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:16:51.553772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:16:51.554658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:16:51.555433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:16:51.555433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:16:51.555433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:16:51.555433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:16:51.556287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:51.613098 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:51.627120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119030d1-9fe4-4013-b584-fd639995bf2d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:51.639057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:51.665938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:51.667023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.667407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.667811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.668600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:51.669422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2952d6-c6d6-44fa-85a6-f72c9dd65546 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:51.670201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:51.709950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:51.710581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.710852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.711127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.711852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:51.712178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:51.713553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b0c5-d50e-43e6-9bbc-eb4d38331a6c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:51.727006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 17/31] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:51.727006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:51.727006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:51.727006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:51.742691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:51.743847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:51.823516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 18/32] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:51.823516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:51.939533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:51.992111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 15/33] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 16:16:51 2022] POST /identity/v3/roles => generated 219 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:16:51.993406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.002076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e314c5-d669-44dd-9001-58d8972a8223 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.106509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.107152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.107435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.107740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.108943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:52.109255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.110716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.145859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 19/34] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:52.151511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.204207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd007-fe27-48b7-a005-3786897e2b6e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.251208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.252301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.252591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.252874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.254753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.256944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.259401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 16/35] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:16:51 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:52.260488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.285768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706192f7-4872-4fbd-b8ea-875f23177a38 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.289364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:52.315149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:52.325853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.326742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.328052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.328494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.329625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.331448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1ab4c-776b-4d55-bb27-6c68bffd01aa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.394125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c059-13d1-435b-bff0-986c14991c50 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.428080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.428725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.429034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.429321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.430040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.431431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c37b-ba96-45b8-bd9e-b12975b90fdd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.499779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 17/36] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 16:16:52 2022] POST /identity/v3/roles => generated 225 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:16:52.501985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a198-054d-40f0-951b-59057d32c56a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.502226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a198-054d-40f0-951b-59057d32c56a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.502536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a198-054d-40f0-951b-59057d32c56a None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.503979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 18/37] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:52.504660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a198-054d-40f0-951b-59057d32c56a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.556684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 20/38] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:16:52 2022] POST /identity/v3/projects => generated 301 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:16:52.558251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c1eb-f2a3-422a-ace7-c81f2433d707 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.558549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c1eb-f2a3-422a-ace7-c81f2433d707 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.558834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c1eb-f2a3-422a-ace7-c81f2433d707 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.560436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 21/39] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:52.562035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823a4f-4f3b-4f73-a3b4-d66524a22b7a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.562583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823a4f-4f3b-4f73-a3b4-d66524a22b7a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.562859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823a4f-4f3b-4f73-a3b4-d66524a22b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.584639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-67823a4f-4f3b-4f73-a3b4-d66524a22b7a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:52.587079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67823a4f-4f3b-4f73-a3b4-d66524a22b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:52.685941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 22/40] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:52.696356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.696704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.696940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.717256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:52.723172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:52.749615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:52.776735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a198-054d-40f0-951b-59057d32c56a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.808421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 23/41] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:52.821775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.822707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.823200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.823692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.825084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.826758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.829419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 19/42] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:52.839405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.882257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:52.943990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea445-f57b-458d-a156-59e1b83c4fdc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.975813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.980858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.981345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.981611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.981894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] PATH_INFO: `/v3/domains/default/users/caf63f3d1ac541d4a3b8a169250bb417/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.984574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=caf63f3d1ac541d4a3b8a169250bb417, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.986167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:53.078256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2c075-f017-4a42-957e-4fd1b6603d7a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:53.079251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 24/43] 10.222.0.43 () {58 vars in 1361 bytes} [Fri Aug 19 16:16:52 2022] PUT /identity/v3/domains/default/users/caf63f3d1ac541d4a3b8a169250bb417/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:16:53.084362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:53.121420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:53.122091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:53.122381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:53.122657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:53.124573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:53.126566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:53.128581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 20/44] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:53.134481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:53.155130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:53.197526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:53.201511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7486b2-966f-4ca9-8795-a948ec030554 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:53.245077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:53.245704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:53.245989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:53.246269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:53.246944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:53.248488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa40b5b-1821-4be9-819a-d464bd24dbda None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:53.260371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5736-1ef1-4807-94d5-f8f9b9487d7e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:53.294681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:53.295408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:53.295878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:53.296166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:53.296820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:53.298303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20544-1e25-4bbc-a7dc-6fce97b93201 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:53.315102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 25/45] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 16:16:53 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:16:53.395426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 21/46] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:16:53 2022] POST /identity/v3/projects => generated 312 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:16:54.978109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc6b3-4ffb-4aec-a91d-1f4c4c70275b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:54.978637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc6b3-4ffb-4aec-a91d-1f4c4c70275b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:54.978720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc6b3-4ffb-4aec-a91d-1f4c4c70275b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:54.980040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 26/47] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:54.985427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ba8c-8e5e-4186-8c88-c8e7c37317b6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:54.985865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ba8c-8e5e-4186-8c88-c8e7c37317b6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:54.985985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ba8c-8e5e-4186-8c88-c8e7c37317b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.005010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6696ba8c-8e5e-4186-8c88-c8e7c37317b6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:55.006521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6696ba8c-8e5e-4186-8c88-c8e7c37317b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:55.063747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:55.071754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 22/48] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:55.313016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e349-4786-44bb-81ba-89c7e61678c4 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.313311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e349-4786-44bb-81ba-89c7e61678c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.313598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3e349-4786-44bb-81ba-89c7e61678c4 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.314950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 27/49] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:55.320078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.320373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.320655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.338944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:55.340166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:55.343649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3e349-4786-44bb-81ba-89c7e61678c4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.409303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 23/50] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:16:55.445487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3e349-4786-44bb-81ba-89c7e61678c4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:55.477473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:55.478099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.478382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.478656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.489057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:16:55.493780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:16:55.494613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:16:55.495552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 28/51] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:16:55.501137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.596380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a6662-a66c-4491-875b-7972c1a86e73 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:55.618579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:55.629590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:55.630230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.630520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.630801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.631514 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:55.631818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:55.633232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:55.646146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:55.651586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.671042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:55.683989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.754003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4fc4-62bf-4abe-9853-d2a2fe2ccaa2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:55.789375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523eed0-20db-4345-95c4-9ca10b75ea9e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:55.826689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:55.827876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.828164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.828437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.829663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:55.831167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:55.832858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 25/53] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:55.838549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.894741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:55.895410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.895725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.896008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.896183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:55.897141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:55.898614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:55.900274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 29/54] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:16:55 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:55.906696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:55.940214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d831-85ca-4267-a180-51ebc482c7b1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:55.974337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:55.974975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:55.975262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:55.975576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:55.976229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:55.977692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee91a-148f-47bc-a9d3-77e46caa0245 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:55.991856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:56.006044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed24e-0b4d-4044-a96f-a1cb6c828130 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:56.040533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:56.041180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:56.041471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:56.041752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:56.042900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:56.044427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:56.046068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:56.051891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:56.066936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 26/56] 10.222.0.43 () {60 vars in 1140 bytes} [Fri Aug 19 16:16:55 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:16:56.171972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dccbe-1b24-4398-a32c-94e09a11d959 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:56.209379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:56.209999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:56.210284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:56.210594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:56.211335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.domain.id=default, user.id=caf63f3d1ac541d4a3b8a169250bb417) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:16:56.211689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:56.213139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bbfe6-89cd-47c5-91cd-6ac5e8c9bc6d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:56.222481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 31/57] 10.222.0.43 () {56 vars in 1322 bytes} [Fri Aug 19 16:16:56 2022] GET /identity/v3/role_assignments?user.id=caf63f3d1ac541d4a3b8a169250bb417&scope.domain.id=default&role.id=80a461100b904c7e8f047066bc70bf3b => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:16:57.952069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937540f9-5302-4afc-ba2b-1c304e522955 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:57.952577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937540f9-5302-4afc-ba2b-1c304e522955 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:57.952657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937540f9-5302-4afc-ba2b-1c304e522955 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:57.953971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:57.959458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:57.959871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:57.960033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:57.977676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:57.978883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:57.991962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:58.043451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:16:58.310065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937540f9-5302-4afc-ba2b-1c304e522955 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:58.413029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937540f9-5302-4afc-ba2b-1c304e522955 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:58.419716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:58.447236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:58.447893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:58.448181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:58.448457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:58.449580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:58.451079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b733-95ab-4ad2-a3b2-6403aa6cc07f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:58.453468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:16:58.458690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:58.556122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743c827-53d7-49a0-b41e-333c4a95b9e8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:58.588577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:58.589181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:58.589468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:58.589743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:58.590396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:58.591881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7daab-079e-4626-96cf-54cd76c86206 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:58.711974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:16:58 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:17:01.745512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699c21-3056-4029-94e7-931044bf168d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:01.746398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699c21-3056-4029-94e7-931044bf168d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:01.746884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699c21-3056-4029-94e7-931044bf168d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:01.748512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:01.760140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94824-735d-4992-875e-3c35bb25a939 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:01.760991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94824-735d-4992-875e-3c35bb25a939 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:01.761449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94824-735d-4992-875e-3c35bb25a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:01.772476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:01.788488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6c94824-735d-4992-875e-3c35bb25a939 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:01.789700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6c94824-735d-4992-875e-3c35bb25a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:01.885491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:01.918904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261681-de03-4359-93ca-c12847a08c16 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:01.919198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261681-de03-4359-93ca-c12847a08c16 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:01.919509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261681-de03-4359-93ca-c12847a08c16 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:01.922170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 30/64] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:01.927628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f181b2-bbf0-4cf6-b333-14ca8951eaad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:01.928173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f181b2-bbf0-4cf6-b333-14ca8951eaad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:01.928651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f181b2-bbf0-4cf6-b333-14ca8951eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:01.956516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d7f181b2-bbf0-4cf6-b333-14ca8951eaad None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:01.958460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7f181b2-bbf0-4cf6-b333-14ca8951eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:02.027722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fee9a-a1c7-48c4-abfa-db9c4e338838 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.028325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fee9a-a1c7-48c4-abfa-db9c4e338838 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.028829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fee9a-a1c7-48c4-abfa-db9c4e338838 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.030814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 31/65] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:02.036268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659e13-0203-4298-91a1-1bf593128840 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.036812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659e13-0203-4298-91a1-1bf593128840 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.037347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659e13-0203-4298-91a1-1bf593128840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.046964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 35/66] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:02.068729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ec659e13-0203-4298-91a1-1bf593128840 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:02.070390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ec659e13-0203-4298-91a1-1bf593128840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:02.173226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 32/67] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:02.190740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9955fe-e296-48d6-aed1-be1f52db1994 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.191241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9955fe-e296-48d6-aed1-be1f52db1994 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.191714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9955fe-e296-48d6-aed1-be1f52db1994 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.193191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 36/68] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:02.198479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.198920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.199338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.228475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:02.229870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:02.266764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9955fe-e296-48d6-aed1-be1f52db1994 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.309004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 33/69] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:02.403530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:02.440196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.460310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9955fe-e296-48d6-aed1-be1f52db1994 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.477535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:02.501019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.501669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.501959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.502244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.513479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a0a245f5-4733-442f-9cf8-3fb979698fc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:02.519219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:02.520090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:02.520857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 37/70] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:02.525471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45bf00-7168-4f66-a991-d023e50ccdaa None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.525764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45bf00-7168-4f66-a991-d023e50ccdaa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.526045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45bf00-7168-4f66-a991-d023e50ccdaa None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.527986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 38/71] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:02.528663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45bf00-7168-4f66-a991-d023e50ccdaa None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.556294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745984a-71a4-4297-9a27-64141ab4d89e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.595489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.596158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.596446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.596725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.609987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:02.615151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:02.616266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:02.617022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 34/72] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:02.621993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.636498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45bf00-7168-4f66-a991-d023e50ccdaa None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.661183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:02.673097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.673901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.674089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.674375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.684875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-31da8f2e-0b72-486e-98ba-9007ec50db49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:02.689932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:02.690754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:02.691523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 39/73] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:02.696830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.696830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.696830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.711316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:02.712548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:02.725431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:02.731714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a1e8-1aef-4477-8016-f2dd54247e61 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.764963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.765626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.765841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.766115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.766785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:02.767091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:02.768519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:02.781570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 35/74] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:02.781570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.784128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 40/75] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:02.785040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.887819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f300c1-eec9-4fd2-980d-b187a7f32e60 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.893410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c52a7-b58d-44ac-9c93-1f135176b83d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:02.907430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:02.928300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.928933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.929033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:02.929243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.929483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.929575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:02.929817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:02.930097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:02.930768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:02.931077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:02.932585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:02.941031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:02.946768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 36/76] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:02.946768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:02.946946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:02.948172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 41/77] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:02.948935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:02.971756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.056138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e451014-7282-4fcf-a2ba-d258ec5e38f0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.056636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de9b2-c6df-4022-8f6a-063c131bf3d1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.089830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.090538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.090683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.090813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.091091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.091296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.091611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.091890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.093082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:03.093393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.094796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.102954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 37/78] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.103779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.108640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.110175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.111859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 42/79] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:02 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.112632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.142724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.183175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.202417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9554a-0ed9-423e-a41f-0a197c24fb84 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.217880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe3e5-248f-4fab-a0f3-3a80bdbcd951 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.237544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.238174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.238458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.238735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.239899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.241357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.242928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 38/80] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.243792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.252978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.253591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.253878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.254158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.254831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:03.255146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.256578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.264745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 43/81] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.265531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.340766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ea49-a43e-4ddf-a26f-b4798fd8fb22 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.361319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.367535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750d53-972d-4f51-8106-6cfac0774573 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.375103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.375770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.376056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.376333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.377453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.378917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.380507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 39/82] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.391441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.399865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.400813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.401448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.401728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.402011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.403170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.405363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.406942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 44/83] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.407725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.479205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a608df-411d-46c0-91b1-9e7ace6d94ad None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.506200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d41a0-80d0-4d09-b058-698a974301bd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.513104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.513693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.513982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.514288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.539339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.539978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.540268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.540548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.573214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.583225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.584745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.601092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.610322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.611896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.680877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:03.681642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.711241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 45/85] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:03.712093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.771352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.783612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c120-cf72-4c1c-8981-e661c5d60632 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.799907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:03.809886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8485e-8fae-42ce-a1bd-d46df01f5b31 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.817029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.817699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.817986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.818265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.819397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.820887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.822606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 41/86] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:03.823198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.848965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.849578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.849866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.850146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:03.850792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:03.852244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:03.921068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edd23-b982-402a-8f25-9fce8743556b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:03.944067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 46/87] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:03 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:03.944067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:03.969271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:03.969919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:03.970208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:03.970488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.027788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.044911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.046648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.056909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6671975-6d22-45db-8275-df5f11a312b2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.078722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.097381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.098038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.098332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.098615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.099842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.101341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.102999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 47/88] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.103865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.161288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 42/89] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:04.162321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.235854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb0d88-ab63-4ec2-ae56-6e404d7c633e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.272471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.282871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.291102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 48/90] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.291512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.292338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a00a-9b65-45ad-a006-7588d003e642 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.338201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.339343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.339661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.339943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.359302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.413243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981add53-e686-40db-9a7f-80378863c7f7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.427122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.429546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.449893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.450524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.450811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.451091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.452189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:04.452523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.453990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.460252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 49/91] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.461078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.562918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.580478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 43/92] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:04.581349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.605674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530b80-0ebb-4dfd-83f9-a3d12e57e73a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.627905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.686960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.688249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.688697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.689110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.690416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.692099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.693886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 50/93] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.694895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.707077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995742-0c54-409d-9b72-dcd2507608e7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.757131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.757753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.758036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.758360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.759380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=caf63f3d1ac541d4a3b8a169250bb417) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:04.759725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.761589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.769279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 44/94] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/role_assignments?user.id=caf63f3d1ac541d4a3b8a169250bb417&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.770577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:04.864490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:04.877781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4086-6df7-4693-812c-0a753c1e498c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.927684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64543b8a-e195-4306-a4a8-6ebf1ce50c4f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:04.965429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.966052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.966336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.966612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.968054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:04.968359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.969975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.977030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:04.977685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:04.979527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 45/95] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.979636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:04.979930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] PATH_INFO: `/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:04.981147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] RBAC: Authorizing `identity:get_project(project_id=6aebda4691cc48fbbf1bed283b6af5fc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:04.982699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0111-3f70-4ec3-bfe7-3443cb41a50e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:04.984632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 51/96] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:04.992732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:05.131693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f127883-f37e-41c4-89f1-b0c8cb20bfb0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:05.146865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:05.171104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:05.171675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:05.172000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:05.172274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:05.173009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=6aebda4691cc48fbbf1bed283b6af5fc, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:05.173387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:05.174863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bdb25-43c5-4e95-90f2-455f18ebd906 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:05.181229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 46/97] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:04 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=6aebda4691cc48fbbf1bed283b6af5fc&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:06.450376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a36e-a74b-4544-a7e3-cd06113ab9ff None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:06.451335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a36e-a74b-4544-a7e3-cd06113ab9ff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:06.451860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a36e-a74b-4544-a7e3-cd06113ab9ff None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:06.453414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 52/98] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:06.463121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:06.463909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:06.464351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:06.488415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:06.489943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:06.542879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0b85-0d8e-48ac-9802-27c92fb56c4f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:06.543391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0b85-0d8e-48ac-9802-27c92fb56c4f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:06.543896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0b85-0d8e-48ac-9802-27c92fb56c4f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:06.545884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 53/99] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:06.552046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:06.552505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:06.552917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:06.585632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:06.587980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:06.629709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 47/100] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:06.689233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:06.714884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 54/101] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:07.035140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.162407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bffea8-939e-4774-8601-37ff073e4433 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.171057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:07.202801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.203454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.203767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.204111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.208154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.209637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.211582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 48/102] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:07.216917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.252387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.358855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d695d9-d673-4853-a7a7-b3f722185663 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.399839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.401198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.401743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.402205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.411590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa5ba-b8ac-434b-9db5-bece063ff590 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.417586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:07.423452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:07.424476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:07.425221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:07.432242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 49/103] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:07.437257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.479849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:07.489901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.490537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.490829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.491191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.491793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.493248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07f368-4e89-4ea7-bf8e-ae768cbbba86 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.546282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39521-f949-4823-acc1-2a9ae6eded6b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.583047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.586417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.586929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.587434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.588386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:07.588889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.590544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.600062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 50/104] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:07.612590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.621428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 55/105] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:17:07 2022] POST /identity/v3/projects => generated 302 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:07.727904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:07.736257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e544-6e98-4bf3-b3e7-128eca89e273 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.740554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78f2a-d9f7-4e98-ae8f-e98f6960eb90 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.741081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78f2a-d9f7-4e98-ae8f-e98f6960eb90 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.741602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78f2a-d9f7-4e98-ae8f-e98f6960eb90 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.743159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 56/106] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:07.748984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.749535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.750031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.788652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:07.789878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:07.808471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.809500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.809964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.810492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] PATH_INFO: `/v3/users/fe5312b17aad4f30a63414f94acc84be` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.829991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] RBAC: Authorizing `identity:get_user(user_id=fe5312b17aad4f30a63414f94acc84be)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.831667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70041b28-ddcc-459a-a5c9-7ff31df20a3e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.833539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 51/107] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/users/fe5312b17aad4f30a63414f94acc84be => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:07.834933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafaeba-f3a1-47ff-9361-9230374e56dd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.835294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafaeba-f3a1-47ff-9361-9230374e56dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.835698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafaeba-f3a1-47ff-9361-9230374e56dd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.837308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 52/108] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:07.838471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67059a0-7a32-470e-9ef1-97ab773760ef None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.838858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67059a0-7a32-470e-9ef1-97ab773760ef None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.839217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67059a0-7a32-470e-9ef1-97ab773760ef None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.840544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 53/109] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:07.842866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:07.846853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f11c-1d71-43ef-8485-33c49e2408ff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.847225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f11c-1d71-43ef-8485-33c49e2408ff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.847627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f11c-1d71-43ef-8485-33c49e2408ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.866849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e1e4f11c-1d71-43ef-8485-33c49e2408ff None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:07.868158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1e4f11c-1d71-43ef-8485-33c49e2408ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:07.899334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 57/110] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:07.900524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.964119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 54/111] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:07.965912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.966318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.966674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.992714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:07.994078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:08.029143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8b91-4b66-467e-9459-97c6c36f7927 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.075744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 55/112] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:08.077389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.078533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.078533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.078825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.124551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.171078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:08.176687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:08.257399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.274970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.301664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 58/113] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:08.306948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.407019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b102c1-05d9-4bf4-8c54-efdc101c428a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.434808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.453203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.455311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.455630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.455912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.479666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:08.485474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:08.486733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:08.487529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 56/114] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:08.488150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.501470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8314a-570d-4b96-91d6-716310276886 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.542957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.543634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.543970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.544252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.546002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:08.547829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:08.549956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 59/115] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:08.550574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.595955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.625915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775848d9-d052-483a-a04e-3fe127f58c26 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.661196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.661753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.662036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.662314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.673512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:08.678665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:08.679544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:08.680314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 57/116] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:08.680922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.684088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0781895-b30c-486b-8a61-5840b2e870d8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.725619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.726786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.726967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.727257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.728246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:08.728558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:08.730240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:08.731636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.744779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 60/117] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:08.744779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.789426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7a4d7-638d-44b2-823a-98c2198aee63 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.826030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.827420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.827741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.828080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.830649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.841368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a9a3c4d1-0c18-4502-92ff-482937f346dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:08.847510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:08.848583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:08.849675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:08.850415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c101d-f7fb-4d5c-a2ce-f57029d0157f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:08.855626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 58/118] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:08.856832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b702-7570-41a9-b6e1-a8d06c881750 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.857183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b702-7570-41a9-b6e1-a8d06c881750 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.857902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b702-7570-41a9-b6e1-a8d06c881750 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.859131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 59/119] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:08.863554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b702-7570-41a9-b6e1-a8d06c881750 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.885667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:08.886372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:08.886775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:08.887113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:08.887955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=fe5312b17aad4f30a63414f94acc84be) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:08.888341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:08.890413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:08.896391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 61/120] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/role_assignments?user.id=fe5312b17aad4f30a63414f94acc84be&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:08.897096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:08.980696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:08.986052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b702-7570-41a9-b6e1-a8d06c881750 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.028849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.029835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.030364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.030783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.031745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:09.032210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.033875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.038160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4fb2-b56d-4ad4-a1f6-e0b322274c73 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.044129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 60/121] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.045227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.086219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.086993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.087363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.087743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.089002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.091074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b6aca-faa4-4137-962c-1a45183f3974 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.093402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 62/122] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:08 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.096688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.097114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.097511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.115629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.116123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:09.117488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:09.174303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d730-ed7f-49cb-a1f5-03764b6cb7a1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.197481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 63/123] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:09.204105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.232814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.233578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.234003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.234387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.235173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:09.236986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.238495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.258581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 61/124] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.260940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.335866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.374245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b0190-508c-49fa-bf9f-8b8fa571f429 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.410736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.411569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.411994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.412377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.413655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.415304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.417227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 64/125] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.417946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.512853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26c90-3e6f-40fd-b570-7d334618be01 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.521907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85a9eb-1e2d-4b36-9b38-a96490ff98c7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.530554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.548894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.549742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.550170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.550613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] PATH_INFO: `/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.550891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.552114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] RBAC: Authorizing `identity:get_project(project_id=6aebda4691cc48fbbf1bed283b6af5fc)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.553738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.556522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 62/126] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.557477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.564218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.564987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.565371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.565717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.567742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.568943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.570511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 65/127] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.571393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.692569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4246471-e6da-4316-a4e7-fff1c9b701dd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.694433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11fba-29a2-4f6c-82fb-942c00f60f4d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.728715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.729476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.729870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.730255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.733997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.734793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.735218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.735663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.736966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.738661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.740716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 63/128] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.741627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.743215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:09.748990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:09.750176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:09.751155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:09.752798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 66/129] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:09.753721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.806167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.812376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:09.856174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6da6d-b7b1-4412-9944-6b064c7506fb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.859881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121354-a423-4210-81c8-87ed46f7f96f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:09.895211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.895992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:09.896119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.896547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.896925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.897226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:09.897647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:09.898059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] PATH_INFO: `/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc/users/382ba35c370742fcb658244cd3f22466/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:09.898473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.900087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.900525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] RBAC: Authorizing `identity:create_grant(project_id=6aebda4691cc48fbbf1bed283b6af5fc, user_id=382ba35c370742fcb658244cd3f22466, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:09.902221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 67/130] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:09.902555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:09.903006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:09.984801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 64/131] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:09 2022] PUT /identity/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc/users/382ba35c370742fcb658244cd3f22466/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:09.986632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:10.019622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fadd-de62-40df-8b96-d09346fe594e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.057707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:10.078486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.079643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.083712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.083712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/382ba35c370742fcb658244cd3f22466/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.083712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, user_id=382ba35c370742fcb658244cd3f22466, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.085219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.130644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d3db5-9907-4890-9f9b-d0091005350c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.151277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:10.174018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 68/132] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:09 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/382ba35c370742fcb658244cd3f22466/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:10.176442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.176565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:10.177351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.177847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.178285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.179624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:10.180129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.182877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92323-5e7b-4b06-b077-30bb054c10c8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.196574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 65/133] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:10.198139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f219-aa47-4043-99b0-8eb352833237 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.198568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f219-aa47-4043-99b0-8eb352833237 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.198985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f219-aa47-4043-99b0-8eb352833237 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.200510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 66/134] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:10.204157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929f219-aa47-4043-99b0-8eb352833237 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:10.343936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929f219-aa47-4043-99b0-8eb352833237 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.382873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809032-78e3-4d51-9ef1-41a8f90c3fdb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.386555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.387205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.387506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.387788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.389526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.391232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966aa3-0d6a-4470-af73-30f9ae6099a1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.393571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 67/135] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:10 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:10.394711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.395118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.395398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.419422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:10.421382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:10.423810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.424852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.425374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.425830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/caf63f3d1ac541d4a3b8a169250bb417/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.428214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, user_id=caf63f3d1ac541d4a3b8a169250bb417, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.430081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.466406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:10.492730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:10.493699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:10.508865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 69/137] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:10 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/caf63f3d1ac541d4a3b8a169250bb417/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:10.616148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2eb46-3beb-454a-ab09-1c4b47ac11be None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.660577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.661307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.661603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.661886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.663133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.664678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.666477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 69/138] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:10 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:10.672715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:10.740123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:10.808339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b79-9d47-465c-ab36-d109f11caaf8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:10.854119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:10.854807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:10.855098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:10.855384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/382ba35c370742fcb658244cd3f22466/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:10.858284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, user_id=382ba35c370742fcb658244cd3f22466, role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:10.860496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:10.933483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 70/139] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:10 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/382ba35c370742fcb658244cd3f22466/roles/c5d478f6f3b741fe926104027a3c5529 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:10.971803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:11.028189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:11.093335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ce757-8c26-488b-a093-41f3bd9c34f8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:11.137523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:11.138180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:11.138471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:11.138757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:11.144335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:11.145863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09558f-d4ed-4fa9-9bdd-b78d8f827c40 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:11.147891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 70/140] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:11.153215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:11.264430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081c1c-3416-4ea2-8d50-4aa5ec06473c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:11.271832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:11.302774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:11.303407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:11.303729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:11.304014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:11.304736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:11.306214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:11.415239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf63e-c428-4269-9a4c-924307263fcf None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:11.415577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf63e-c428-4269-9a4c-924307263fcf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:11.415865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf63e-c428-4269-9a4c-924307263fcf None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:11.417464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 71/141] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:11.423236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:11.423552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:11.423849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:11.447370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 71/142] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:11 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:11.461525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:11.462850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:11.557712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 72/143] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:12.089783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:12.212225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535a1b-ac63-4315-ad09-8021950a34ce None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:12.254428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:12.255173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.255460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.255763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.270785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-cc2f96a1-f453-4d07-aad1-49e3a33ca5de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:12.276149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:12.276968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:12.278117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 72/144] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:12.284202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:12.358523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:12.391834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e3c8-566b-4085-a202-199de50f0382 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.392127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e3c8-566b-4085-a202-199de50f0382 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.392392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e3c8-566b-4085-a202-199de50f0382 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.393736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 73/145] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:12.399569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.399886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.400132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.434702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69c97-b2d7-46cb-b4d3-d54f5aa21575 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:12.434886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:12.436772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:12.463657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:12.481639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:12.482266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.483116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.483401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.484183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:12.484498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:12.485925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:12.494824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 73/146] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:12.501013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:12.582862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 74/147] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:12.645138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2bd61-2c21-403c-a605-d48171662ec1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:12.646599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:12.681905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:12.682549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.682838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.683121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] PATH_INFO: `/v3/users/fe5312b17aad4f30a63414f94acc84be` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.684324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] RBAC: Authorizing `identity:get_user(user_id=fe5312b17aad4f30a63414f94acc84be)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:12.686461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:12.688824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 74/148] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:12 2022] GET /identity/v3/users/fe5312b17aad4f30a63414f94acc84be => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:12.694457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:12.811044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb542e-1277-4a30-b395-4675c5eddeba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:12.854732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:12.855381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:12.855697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:12.855977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:12.860204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:12.861707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5881d-0ee0-4808-9ec8-68742ea64690 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:12.863702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 75/149] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:12 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:12.869505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.030395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb3a1-8939-4ed3-9994-e1703227fca0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:13.073125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:13.073807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.074089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.074365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/fe5312b17aad4f30a63414f94acc84be/roles/2e64c4905eb84ec0a1b824b3b076c5d0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.076392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, user_id=fe5312b17aad4f30a63414f94acc84be, role_id=2e64c4905eb84ec0a1b824b3b076c5d0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:13.078339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:13.084543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e6b6-5496-455d-9f49-e0186d3b631c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.084831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e6b6-5496-455d-9f49-e0186d3b631c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.085114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e6b6-5496-455d-9f49-e0186d3b631c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.086788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 76/150] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:13.091851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.092420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.092676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.130137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:13.131362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:13.148291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:13.150411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 75/151] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:12 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/users/fe5312b17aad4f30a63414f94acc84be/roles/2e64c4905eb84ec0a1b824b3b076c5d0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:13.151261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.221959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:13.290691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:13.360266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b456-df9f-4348-a277-b67cd0eeae2c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:13.405849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:13.406885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.407368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.407889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.424162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:13.429701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:13.430570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:13.431320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:13.434933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 76/153] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:13.441008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.583937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3ec58-a819-4676-b7ab-9550da248daf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:13.623324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:13.624282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.624573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.624853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.625544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:13.625925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:13.627336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:13.637996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 78/154] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:13.643338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.756510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:13.767203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017425cc-c0da-4cda-963a-56aff5700943 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:13.829213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:13.829870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.830158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.830470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:13.831745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:13.833228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:13.834884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 77/155] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:13 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:13.840559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.852445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:13.928390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:13.950448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41c0-8aad-448d-9eed-875ed729fc08 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:13.990520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:13.991160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:13.991451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:13.991755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.095957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:14.097368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e47ab0-d165-42b0-aaaa-f5aa0629ac1d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:14.127894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:14.141481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02493c8a-0449-4494-8500-34e4875aed39 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:14.205164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:14.205809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.206092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.206368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.223981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-807fcfa2-9729-493c-a1eb-551776c86943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:14.229276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:14.230130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:14.230929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:14.235859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 78/156] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:14.237192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfbb96-828a-411e-b05f-a3aadc783ac9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.237478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfbb96-828a-411e-b05f-a3aadc783ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.237756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfbb96-828a-411e-b05f-a3aadc783ac9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.239046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 79/157] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:14.240101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd450-c18e-46fa-8191-2d59ff608669 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.240381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd450-c18e-46fa-8191-2d59ff608669 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.240656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd450-c18e-46fa-8191-2d59ff608669 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.241847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 80/158] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:14.248485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd450-c18e-46fa-8191-2d59ff608669 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:14.265390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 79/159] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:14.266729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2489d5-c5b8-4f7b-8b99-8cd943d0ad0a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.267021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2489d5-c5b8-4f7b-8b99-8cd943d0ad0a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.267301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2489d5-c5b8-4f7b-8b99-8cd943d0ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.297008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:14.306984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5c2489d5-c5b8-4f7b-8b99-8cd943d0ad0a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:14.308235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5c2489d5-c5b8-4f7b-8b99-8cd943d0ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:14.431838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 80/160] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:14.431838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.431838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.431838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.457762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:14.459264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:14.496018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd450-c18e-46fa-8191-2d59ff608669 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:14.506617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:14.578710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 81/161] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:14.579519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:14.583133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:14.584143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.584631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.585109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.586123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:14.586755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:14.588424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:14.606216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 81/162] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:14.612199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:14.738419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc19501-36e9-41a7-820f-143d74823603 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:14.747465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:14.785182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4261159-c3f0-4629-8481-5eea07278680 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:14.820474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:14.821483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.821963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.822462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] PATH_INFO: `/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.824516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=6aebda4691cc48fbbf1bed283b6af5fc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:14.826207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:14.831730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 82/163] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:14 2022] GET /identity/v3/projects/6aebda4691cc48fbbf1bed283b6af5fc => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:14.837010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:14.858697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:14.859742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:14.860229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:14.860698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:14.862338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:14.864787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:14.866822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 82/164] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:14 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:14.874627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:14.905422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.040925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e7c8-3fe4-45d4-9cb5-ed0b81d6e6d1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.056814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6cf2-6a91-4581-818c-e669fa69cd24 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.080390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.081078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.081360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.081633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.082374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=6aebda4691cc48fbbf1bed283b6af5fc, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:15.082689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.084181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.090633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 83/165] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:14 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=6aebda4691cc48fbbf1bed283b6af5fc&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:15.130077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.130942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.131466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.131899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.136069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.159035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.245225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.247693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530db142-0299-4a65-80e9-410375203ed5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.275771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.277656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.286010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.286894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.287279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.287695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.299837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:15.305652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:15.306606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:15.307841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 84/166] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:15.308491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.461630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbaef5-792e-42c3-a100-ff1b2f15b2be None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.502233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 83/167] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:15.503097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.537284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.537926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.538212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.538485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.561292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:15.567176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:15.568067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:15.569269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 85/168] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:15.570015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.601856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.626669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.711830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b9abe-7a58-4f25-8fda-d7610d74135b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.726729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbedd8-da56-4ef0-bf2c-f50a08a5cdcb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.749220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.749835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.750112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.750384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.751051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:15.751352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.752844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.761849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 84/169] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:15.762702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.771474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.772159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.772442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.772717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.773933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.775423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc0d0b-35f6-47c4-87f3-89ccd8a89c74 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.777102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 86/170] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:15.778315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab685-d300-41b6-b8f5-bf46a1d2225c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.778600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab685-d300-41b6-b8f5-bf46a1d2225c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.778876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bab685-d300-41b6-b8f5-bf46a1d2225c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.784669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 87/171] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:15.785456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bab685-d300-41b6-b8f5-bf46a1d2225c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.871016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb976b5-423b-4901-b38d-c515d27e018c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.881805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.889537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:15.903765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bab685-d300-41b6-b8f5-bf46a1d2225c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:15.908532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.912379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.912738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.913623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.914486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:15.914969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.917308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ade14-b4af-425d-aa4e-b562004e0867 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.937896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 85/172] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:15.939643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.940134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.940637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.949127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:15.949755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:15.950125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:15.950459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] PATH_INFO: `/v3/users/caf63f3d1ac541d4a3b8a169250bb417` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:15.951691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] RBAC: Authorizing `identity:get_user(user_id=caf63f3d1ac541d4a3b8a169250bb417)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:15.953245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:15.955136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 88/173] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/users/caf63f3d1ac541d4a3b8a169250bb417 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:15.955964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:15.976685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:15.978280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:16.074283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60213e-ec90-43de-823b-57de59d8e7fa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:16.113748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 86/174] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:16.115023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:16.115361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:16.119504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:16.126685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 89/175] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:15 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:16.127511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:16.152929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:16.294623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378f41-5c71-4114-b565-dd1cfeddf65f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:16.332593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d94e2f-60b2-4d2f-b94c-76966d5a4390 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:16.334655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:16.397207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:16.397829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.398117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.398395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.410507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:16.411530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.412018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.412492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] PATH_INFO: `/v3/users/382ba35c370742fcb658244cd3f22466` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.413950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] RBAC: Authorizing `identity:get_user(user_id=382ba35c370742fcb658244cd3f22466)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:16.415779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:16.417875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 87/176] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/users/382ba35c370742fcb658244cd3f22466 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:16.427603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:16.490505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:16.492726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d954-2cac-48d3-944d-39e93997d2fe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:16.517272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:16.604538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 90/177] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:16.606136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249ba4f-4977-4753-b39b-c9976415aabb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.606594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249ba4f-4977-4753-b39b-c9976415aabb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.607043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249ba4f-4977-4753-b39b-c9976415aabb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.609387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 91/178] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:16.615427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.615959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.616402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.633706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af5a6-0c1e-4d9c-9bf4-61451ec360f6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:16.653948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:16.656350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:16.699134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:16.699805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.700088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.700363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.746815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 92/179] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:16.747743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:16.751211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:16.817264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:16.818762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:16.842063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:16.930287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39e678-ac3a-45b8-a597-826e6eaff4c6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:16.964260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 88/180] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:16.969515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:16.973537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:16.974536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.975034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.975540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.976950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:16.978696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29f99f-b3ec-447f-8215-6f7a7a7b6052 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:16.980658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 93/181] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:16.982143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f00af-e4ce-402b-8b78-786df13251b3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:16.983281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f00af-e4ce-402b-8b78-786df13251b3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:16.983975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f00af-e4ce-402b-8b78-786df13251b3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:16.985624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 94/182] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:16.990526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f00af-e4ce-402b-8b78-786df13251b3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.036391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.067584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e25c9-0eb3-4b7b-9821-3f75efc64785 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.100205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f00af-e4ce-402b-8b78-786df13251b3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.100534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.101169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.101446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.101718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.113331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:17.118278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:17.118602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:17.119439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 89/183] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:17.128967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.136386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.137033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.137318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.137599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.138787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.140702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac07b01-9a76-4c1f-8104-c4dcc725f3f2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.142360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 95/184] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:16 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.143477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5245-308f-4a2c-b36d-cd9282bdd776 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.143784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5245-308f-4a2c-b36d-cd9282bdd776 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.144059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5245-308f-4a2c-b36d-cd9282bdd776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.162096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d92f5245-308f-4a2c-b36d-cd9282bdd776 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:17.163302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d92f5245-308f-4a2c-b36d-cd9282bdd776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:17.223437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd17c6-adfc-4c5b-b56d-a88ec5bdf662 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.229992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 96/185] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:17.231296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c061-091d-414e-8cc9-628f8d641203 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.231618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c061-091d-414e-8cc9-628f8d641203 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.231893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c061-091d-414e-8cc9-628f8d641203 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.233905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 97/186] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:17.234473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c061-091d-414e-8cc9-628f8d641203 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.255544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.262832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.263445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.263848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.265858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.265858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=caf63f3d1ac541d4a3b8a169250bb417) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:17.265858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.267524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.273836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 90/187] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/role_assignments?user.id=caf63f3d1ac541d4a3b8a169250bb417&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.274494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.392640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c061-091d-414e-8cc9-628f8d641203 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.393414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd662fa-3561-4ef6-8fd4-31edf385f923 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.418845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.438719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.439285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.439792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.440179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.440923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:17.441228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.442669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.445199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.445556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.446187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.446467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.457649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 91/188] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.458572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.468159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1f15adbd-aff2-4357-ad24-9b19dfd9d7fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:17.474650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:17.475649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:17.476442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 98/189] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:17.477087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.477204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.477835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.502533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:17.502533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:17.533216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.575326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 99/190] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:17.587662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.587755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602ef5-9f25-4bf9-b70a-03ee5315c880 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.613664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.614263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.614546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.614818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.615573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=382ba35c370742fcb658244cd3f22466) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:17.615949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.617439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.628425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 92/191] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/role_assignments?user.id=382ba35c370742fcb658244cd3f22466&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.629622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.714281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deb900-3135-469e-9559-e455a1e754b4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.724560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.762962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.763555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.763867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.764144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.768282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daf78-d96d-43d6-941f-28ba2cac863d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.781643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.783428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.785883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 100/192] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.786473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.792413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.808277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.809053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.809165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.809435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.810115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:17.810427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.812956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.822670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 93/193] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.823573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.906069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82806ff-c0fc-44be-ab92-352a135687d8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.931649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d42db6-2c95-4e30-844f-9131c960a83e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:17.940372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.941001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.941282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.941556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.942657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:17.944144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:17.945688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 101/194] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:17.946441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:17.968116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:17.968734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:17.968995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:17.969262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:17.977796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.019053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.036842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.038323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.045587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3454-bf50-42a5-bd77-4b230f398c30 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.079664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.080289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.080567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.080847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] PATH_INFO: `/v3/users/fe5312b17aad4f30a63414f94acc84be` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.081965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] RBAC: Authorizing `identity:get_user(user_id=fe5312b17aad4f30a63414f94acc84be)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.083401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.085151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 102/195] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/users/fe5312b17aad4f30a63414f94acc84be => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:18.085819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.141189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 94/196] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:18.142074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.189187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.192250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a536fd-cef5-4c62-9460-b564081d5fec None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.224158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.225900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.226533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.226817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.227094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.237077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:18.241553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3067f-1255-44d2-a57b-0f3578da0a65 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:18.241859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:18.242750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:18.243606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 103/197] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:18.245194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.275848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.276385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.276673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.276951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.277603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.279056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.339940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591819a9-3b4c-48e1-ba4d-894107e9cf2a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.372293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.372897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.373797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.374070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.437444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.438898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.465617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.534280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 104/198] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:18.535038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.572660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 95/199] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:18 2022] POST /identity/v3/users => generated 297 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:18.573508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.640254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211085-3837-4ca4-bff9-f1f455dabe44 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.654995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.681112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.681930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.682224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.682504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.683759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.685269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.693288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 105/200] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:18.693288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.693562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406fbfd-35df-43f8-b5d2-668476286acd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.737170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.737803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.738089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.738365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.739985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:18.740306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.741734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.747280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.751972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 96/201] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:18.756398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.817419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b319b44-1c9b-4b7f-914a-e50c2e0b1c37 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.859330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:18.870855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.874547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.874547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.874547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.874547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.874865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd3b4-36d6-4862-8c87-ea8a8f56c911 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:18.875259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.876935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 106/202] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:18.877554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:18.918254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:18.918932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:18.919158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:18.919435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:18.920915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=578949ca8f6340ec987811821665fc06) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:18.921314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:18.923798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:18.929236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 97/203] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/role_assignments?user.id=578949ca8f6340ec987811821665fc06&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:18.929480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:19.000356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:19.024233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d776ba-c717-43df-8469-74a43e3e5e80 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:19.043172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440c25-4815-440e-a996-ff1587c775e6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:19.074697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:19.075262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:19.075613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:19.075895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:19.077631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:19.079120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:19.080833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 107/204] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:19.087624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:19.100855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:19.101490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:19.101777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:19.102055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:19.102808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, scope.project.id=456bc72209744ed7b6d753658a72f9e3, user.id=fe5312b17aad4f30a63414f94acc84be) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:19.103126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:19.104647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:19.120909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 98/205] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:18 2022] GET /identity/v3/role_assignments?user.id=fe5312b17aad4f30a63414f94acc84be&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:19.176639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:19.227512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77de83-ba36-4d8d-a9d6-e59fe695b3a5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:19.280574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:19.281557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:19.282062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:19.282545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:19.375117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:19.376634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:19.445868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:19.487641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 108/206] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 16:17:19.493381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:19.615636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973d79d-1bfc-435d-aa70-e858eaa74e43 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:19.640302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:19.648641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:19.652535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:19.652535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:19.652535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:19.652535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:19.652535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d43b-8cb0-4fc9-9a8f-8c5b44e4dc59 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:19.654266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 99/207] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:19 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:19.660328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:19.772483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313bec2-7d91-407d-979c-412287cfcb32 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:19.807645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:19.808263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:19.808661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:19.808941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:19.809686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=578949ca8f6340ec987811821665fc06) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:19.810001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:19.812268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba05a-12e7-4e22-8f86-184db7535fb1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:19.818328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 109/208] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:19 2022] GET /identity/v3/role_assignments?user.id=578949ca8f6340ec987811821665fc06&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:20.799465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402692-c6fa-468a-ae48-85c71d0649aa None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:20.800438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402692-c6fa-468a-ae48-85c71d0649aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:20.800940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402692-c6fa-468a-ae48-85c71d0649aa None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:20.802494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 100/209] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:20.808066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827632-635d-4836-a79f-0afdc135e657 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:20.808939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827632-635d-4836-a79f-0afdc135e657 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:20.809468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827632-635d-4836-a79f-0afdc135e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:20.834513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-32827632-635d-4836-a79f-0afdc135e657 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:20.835756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-32827632-635d-4836-a79f-0afdc135e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:20.860592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:20.881808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a3ed-c74b-4417-9178-6589d7b6efd6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:20.882446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a3ed-c74b-4417-9178-6589d7b6efd6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:20.883056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254a3ed-c74b-4417-9178-6589d7b6efd6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:20.884799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 101/210] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:20.890926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34173f9-676c-45d9-8b35-7a402cd907dd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:20.891607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34173f9-676c-45d9-8b35-7a402cd907dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:20.892105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34173f9-676c-45d9-8b35-7a402cd907dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:20.907791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 110/211] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:20.914030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c34173f9-676c-45d9-8b35-7a402cd907dd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:20.915501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c34173f9-676c-45d9-8b35-7a402cd907dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:20.988293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 102/212] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:21.085175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d71f-c8cb-445c-b987-fec0e85117e7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.085499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d71f-c8cb-445c-b987-fec0e85117e7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.085742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d71f-c8cb-445c-b987-fec0e85117e7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.087106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 111/213] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:21.092851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.093145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.093427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.112374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:21.113563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:21.180874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d71f-c8cb-445c-b987-fec0e85117e7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.190743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 103/214] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:21.286136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.286485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d71f-c8cb-445c-b987-fec0e85117e7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.322880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.323553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.323838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.324122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.335914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:21.340718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:21.341593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:21.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 112/215] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:21.348125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.369141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.370275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.427673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc599ec-21ad-4801-8f92-a3660cbe41f0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.463255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7eb98-baa1-425f-9227-5213eb67468f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.483534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.484607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.485052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.485488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.486925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:21.488961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:21.491870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 104/216] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:21.493432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.504616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.505243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.505524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.505800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.506472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:21.506777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:21.508189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:21.516829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 113/217] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:21.521328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.604083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9ac3-e8da-4155-974f-528809c1445b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.616210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.631276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.637123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636771-7072-476d-8874-a1569db6a568 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.642250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.642888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.643187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.643515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.654651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:21.659787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:21.660659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:21.661449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 105/218] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:21.662096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.678806 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.679456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.679815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.680104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.680758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:21.682240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:21.760917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 114/219] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:21 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:21.761759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.766850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384f70-34e0-4fc3-873c-57dd8334a2b8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.808060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.808743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.808974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.809255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] PATH_INFO: `/v3/users/8ecb5256522a4e6f963f333fea473c8d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.828658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] RBAC: Authorizing `identity:get_user(user_id=8ecb5256522a4e6f963f333fea473c8d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:21.830342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85b3ff-bc25-4330-a4a1-fbfbb1bc5f39 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:21.832272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 106/220] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/users/8ecb5256522a4e6f963f333fea473c8d => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:21.837251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c86d-021f-40f0-8acb-5f24576f73fc None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.837780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c86d-021f-40f0-8acb-5f24576f73fc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.838068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c86d-021f-40f0-8acb-5f24576f73fc None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.839720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 107/221] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:21.840364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c86d-021f-40f0-8acb-5f24576f73fc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:21.895111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.898050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3557c-bc63-41e1-a843-c736a2eed052 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.939191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:21.939844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.940137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.940418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.943540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:21.943540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:21.943540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493217-95ef-47b8-8d64-18e0d5e3c1b1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:21.945734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:21.957706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 115/222] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:21.959890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:21.959890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:21.959890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:21.975158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c86d-021f-40f0-8acb-5f24576f73fc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:21.978851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:21.980095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:22.021814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.022530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.022719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.023640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.075893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 116/223] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:22.075893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.117667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.119587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.174509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.215764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecb669-118f-404c-bb5e-2d1a5cdec108 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.246638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.251331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 108/224] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:22.257570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.260691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.261641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.262125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.262573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.264314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.265975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.268173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 117/225] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:22.274871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.412455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621938-ea62-4128-9439-19741dbf2763 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.457629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.458193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.458478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.459902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.462334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.463834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.465492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 109/226] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:22.472039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.485965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe09d-5700-4bf2-bdaa-8a052f18ebe9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.489499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.525325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.526343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.526848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.527130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.528342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.530376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.532044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 118/227] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:22.532821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.604128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.629067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd638-8073-487f-a672-28cfd8d46703 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.644722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158617d6-dead-4d60-a32c-86daa1acf6fa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.671630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.672385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.672673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.672949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.673772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=8ecb5256522a4e6f963f333fea473c8d) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:22.674104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.675600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.687932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 110/228] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/role_assignments?user.id=8ecb5256522a4e6f963f333fea473c8d&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:22.688891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.691041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.691995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.692487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.692942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.708856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:22.715437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:22.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:22.717794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:22.720565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 119/229] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:22.729873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:22.795944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.822684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae403-8045-4544-96f6-64afb43ffcf4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.861336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.862026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.862310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.862597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/578949ca8f6340ec987811821665fc06/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.864889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, user_id=578949ca8f6340ec987811821665fc06, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.866882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.921801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f59b-c365-4863-a445-bbc0c7e4c472 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:22.953579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 111/230] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:22 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/578949ca8f6340ec987811821665fc06/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:22.958814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:22.972212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:22.973137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:22.973563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:22.974003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:22.974937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:22.975515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:22.977081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:22.988139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 120/231] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:22.994276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:23.114277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494debf-ddba-4595-b158-422ef4085224 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:23.151579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb988442-fc27-4750-920f-d58af915621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:23.152505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988442-fc27-4750-920f-d58af915621e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:23.152952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988442-fc27-4750-920f-d58af915621e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:23.153420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988442-fc27-4750-920f-d58af915621e None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:23.155567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988442-fc27-4750-920f-d58af915621e None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:23.157279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988442-fc27-4750-920f-d58af915621e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:23.159125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 112/232] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:22 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:23.168746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:23.286740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3899-ab48-4f9d-ba75-c491e0999297 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:23.323295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:23.324236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:23.324668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:23.325109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:23.327223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:23.328868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ddd92-ad12-45f0-ae53-88143bcbc732 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:23.330678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 121/233] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:23 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:23.336391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb988442-fc27-4750-920f-d58af915621e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:23.339448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:23.444649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb988442-fc27-4750-920f-d58af915621e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:23.479887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:23.480566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:23.480852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:23.481130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/578949ca8f6340ec987811821665fc06/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:23.484279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, user_id=578949ca8f6340ec987811821665fc06, role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:23.485794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f2c83-91b2-4732-879c-e24fed0cc29c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:23.573298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 113/234] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:23 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/578949ca8f6340ec987811821665fc06/roles/c5d478f6f3b741fe926104027a3c5529 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:24.018543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2b76-3149-4911-9ca2-271334ddf6fc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:24.019037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2b76-3149-4911-9ca2-271334ddf6fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:24.019037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2b76-3149-4911-9ca2-271334ddf6fc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:24.020713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 122/235] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:24.025951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf58-f28d-4a62-9d92-33ca472783aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:24.026355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf58-f28d-4a62-9d92-33ca472783aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:24.026551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bf58-f28d-4a62-9d92-33ca472783aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:24.048492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a39bf58-f28d-4a62-9d92-33ca472783aa None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:24.049733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a39bf58-f28d-4a62-9d92-33ca472783aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:24.125771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:24.141934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 114/236] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:24.384200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af286-9d20-4b54-a4d2-d317f7dd9d9f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:24.384825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af286-9d20-4b54-a4d2-d317f7dd9d9f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:24.385303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af286-9d20-4b54-a4d2-d317f7dd9d9f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:24.386864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 123/237] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:24.392180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:24.392472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:24.392755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:24.416679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:24.417867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:24.502203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 115/238] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:24.593592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af286-9d20-4b54-a4d2-d317f7dd9d9f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:24.663864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:24.726403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af286-9d20-4b54-a4d2-d317f7dd9d9f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:24.774073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:24.774712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:24.774996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:24.775272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:24.788608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:24.793917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:24.795346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:24.796593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 124/239] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:24.801609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:24.866275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:24.955458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb8095-1719-44c7-9b07-79ed23f4b492 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:24.987408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:24.990936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36748-4c60-4448-9a97-c25a35d6a00d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.001246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.001523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.001859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.002135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.002814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:25.003124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.004830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c90aa-ac93-4635-a537-ae8792dfa6c1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.010933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.013338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 116/240] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:25.014986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8f62-cf69-4864-aa3b-77d178381b41 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.016469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8f62-cf69-4864-aa3b-77d178381b41 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.016752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8f62-cf69-4864-aa3b-77d178381b41 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.018252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 117/241] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:25.025370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.025644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.025928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.037081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.038341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.038828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.039302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.040682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.043179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.047531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:25.047964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:25.049872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 125/242] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:25.051649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.131016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 118/243] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:25.131997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.234869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba338-12b5-4a0f-9857-a10b54f955e0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.238396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9c54-b766-4cd6-9ad6-1ed8f9c36792 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.273892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.274795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.275079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.275360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] PATH_INFO: `/v3/users/4f259225ac06429ab4f71c400e8c6aa4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.279312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.292461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] RBAC: Authorizing `identity:get_user(user_id=4f259225ac06429ab4f71c400e8c6aa4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.294486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd89ac-b960-46ed-888d-d424f8b0c7ad None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.297322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 126/244] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/users/4f259225ac06429ab4f71c400e8c6aa4 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:25.299158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d6b-e494-4001-b6a1-832af1b6ff37 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.299448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d6b-e494-4001-b6a1-832af1b6ff37 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.300406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5d6b-e494-4001-b6a1-832af1b6ff37 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.302268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 127/245] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:25.302999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d6b-e494-4001-b6a1-832af1b6ff37 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.305686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.306674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.307037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.307390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.308145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.309684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef7462-3fc6-4ed4-b8dc-a58ae9d9d1a5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.351055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.407898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 119/246] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:25 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:25.411193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.414271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.414997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.417552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5d6b-e494-4001-b6a1-832af1b6ff37 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.451410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:25.452716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:25.474158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.474789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.475070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.475442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.543810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 120/247] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:25.548548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.571247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.572766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.630998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.689635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.693767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e294013-79d4-42f6-8af5-61b6406763cc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.705413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 128/248] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:25.710899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.744442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.745789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.746244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.746623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.766270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:25.773170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:25.774066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:25.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 121/249] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:25.779289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.866881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1a14-ed08-4d0d-87ef-6e6e28c7a55f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.910984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.911676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.911961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.912243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.914403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.915819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaecbc1-a60d-4a7c-aa1e-aa517cd5b490 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:25.916019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.918386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 129/250] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:25.919611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:25.935117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:25.971207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:25.972196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:25.972696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:25.973167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:25.974041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:25.974610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:25.976246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:25.986664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 122/251] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:25.987828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.021003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.063978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cc641-7d5c-4fe0-a55f-5a5748f5e4cc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.109589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.110212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18ec0-01a6-4ae9-9567-d90d9e14247d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.111149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.111643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.112303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.124874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:26.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:26.131254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:26.132068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:26.134528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 130/252] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:26.135640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.153302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.153960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.154873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.155197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.155967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=4f259225ac06429ab4f71c400e8c6aa4) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:26.156595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.157835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.163842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 123/253] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:25 2022] GET /identity/v3/role_assignments?user.id=4f259225ac06429ab4f71c400e8c6aa4&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:26.164582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.219437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.261284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86edba7-6eb9-4da9-b3cd-db2558077780 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.262182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.278085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e081ea-66ee-4924-b3bb-541a05b9ddfb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.318823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.319999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.320632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.321113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] PATH_INFO: `/v3/users/8ecb5256522a4e6f963f333fea473c8d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.322428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.323051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.323331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.323645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.323914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] RBAC: Authorizing `identity:get_user(user_id=8ecb5256522a4e6f963f333fea473c8d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.324318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:26.324620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.326046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.326367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.331607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 131/254] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/users/8ecb5256522a4e6f963f333fea473c8d => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:26.340622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 124/255] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:26.341044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.348546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.479412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82040f-a773-43d2-8066-0adbc0ee15de None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.496282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b063b-67bd-4752-b74c-179e27f61d0b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.526381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.528063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.528351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.528629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.530453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.531965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52db97-344a-4b2d-b8d1-2b63e07dc58b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.533583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 125/256] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:26.534711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deefa1-4f1c-43f5-bbec-dee0b4d192cf None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.534995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deefa1-4f1c-43f5-bbec-dee0b4d192cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.535270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deefa1-4f1c-43f5-bbec-dee0b4d192cf None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.536660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 126/257] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:26.546013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deefa1-4f1c-43f5-bbec-dee0b4d192cf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.555556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.556207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.556486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.556761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.562279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.563827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c490-7c3e-4701-b157-3f676692942e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.567233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 132/258] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:26.569692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.569969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.570243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.585424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.589101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.606746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:26.608251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:26.709023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deefa1-4f1c-43f5-bbec-dee0b4d192cf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.751803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.752341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.752621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.752889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.773498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 133/259] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:26.774361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:26.844902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.846525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.876020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.916128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f584d-78d4-48ef-aab3-a7a25a4e28b2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:26.962773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:26.963450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:26.963749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:26.964020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/8ecb5256522a4e6f963f333fea473c8d/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:26.965929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, user_id=8ecb5256522a4e6f963f333fea473c8d, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:26.967621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:26.970168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:26.984333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 127/260] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:26.992084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:27.079247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 134/261] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:26 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/8ecb5256522a4e6f963f333fea473c8d/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:27.119987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923716-8528-4f33-8e16-aea6a8c44e6a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:27.144627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:27.167344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:27.168086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:27.168376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:27.168656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:27.169848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:27.171422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:27.173348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 128/262] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:26 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:27.182774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:27.194926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:27.358863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ff6c-d0f0-4015-99ad-6aca442526ba None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:27.412623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756692-9da5-4af1-b3d3-92593a7ff0d2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:27.452088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:27.452705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:27.453018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:27.453254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:27.453987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=578949ca8f6340ec987811821665fc06) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:27.454294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:27.455759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:27.459499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:27.460163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:27.460453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:27.460741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:27.461919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 135/263] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:27 2022] GET /identity/v3/role_assignments?user.id=578949ca8f6340ec987811821665fc06&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:27.483533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:27.489004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:27.489936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:27.490725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 129/264] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:27.498866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:27.605999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:27.652811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b694a0-5a54-42d2-bbcc-382371a6237b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:27.694714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:27.695339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:27.695686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:27.695964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:27.696737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:27.696977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:27.699651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:27.711352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 136/265] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:27.718058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:27.798414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:27.868402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6363-45ed-4eed-8ee5-052cffadcd5f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:27.912914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:27.913481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:27.913767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:27.914094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] PATH_INFO: `/v3/users/578949ca8f6340ec987811821665fc06` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:27.915252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] RBAC: Authorizing `identity:get_user(user_id=578949ca8f6340ec987811821665fc06)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:27.916779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:27.923612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 130/266] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:27 2022] GET /identity/v3/users/578949ca8f6340ec987811821665fc06 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:27.925390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:28.048405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295425a-9b33-470f-8546-ce8ecfa2152f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:28.071476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:28.087429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:28.088127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.088443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.088733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.164225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:28.165740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8f133-69b7-4725-89b4-7357c67d1551 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:28.274909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 137/267] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:28.281376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:28.308023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579bbd-55c1-4a39-b1e3-333c16f0c2f7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.308346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579bbd-55c1-4a39-b1e3-333c16f0c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.308577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579bbd-55c1-4a39-b1e3-333c16f0c2f7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.310167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 138/268] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:28.318493 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.318867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.319104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.344285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:28.345619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:28.361790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:28.419573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 139/269] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:28.491208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2a71-9428-4028-b001-7a0bfde3580c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:28.509410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:28.542822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:28.543834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.544701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.545371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.547725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:28.549523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:28.551393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 131/270] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:28 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:28.557498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:28.688887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535f1a-de73-4415-8f43-e3a7b0371484 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:28.725831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:28.726808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.727299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.727772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.728769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=578949ca8f6340ec987811821665fc06) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:28.729252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:28.730883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba0ad-dc5f-4081-90c8-30d0a8b66dcd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:28.738286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 140/271] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:28 2022] GET /identity/v3/role_assignments?user.id=578949ca8f6340ec987811821665fc06&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:28.793019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:28.929832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e2b70-c681-4e74-b756-7a97fb380577 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:28.950764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469308-f4a7-4e8f-963b-db0ed5193603 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.952025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469308-f4a7-4e8f-963b-db0ed5193603 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.952514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469308-f4a7-4e8f-963b-db0ed5193603 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.954079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 141/272] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:28.961270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d788be-ed9b-4200-b56f-398f82151d66 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.961859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d788be-ed9b-4200-b56f-398f82151d66 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.962348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d788be-ed9b-4200-b56f-398f82151d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.979244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:28.979925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:28.980211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:28.980490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:28.983688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b5d788be-ed9b-4200-b56f-398f82151d66 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:28.985168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5d788be-ed9b-4200-b56f-398f82151d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:29.006742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:29.007858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:29.012079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:29.012957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:29.014319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:29.018175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 132/273] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:29.019818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.063742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 142/274] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:29.076550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.088381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff6a34-6b92-4814-ac66-5efafddd498b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.089308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff6a34-6b92-4814-ac66-5efafddd498b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.089796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff6a34-6b92-4814-ac66-5efafddd498b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.095588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 143/275] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:29.098159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.098658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.099156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.118693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:29.120251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:29.146698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235ed6-5d72-4f55-b3be-4bb6364fb281 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.191426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.192073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.192666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.192971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.193656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:29.194225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.195810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.207147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 133/277] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:29.210317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 144/277] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:29.211510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.325185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9611f42-a4a7-4dd1-af62-163f303b2a3d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.327805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.370102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.370752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.371032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.371306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] PATH_INFO: `/v3/users/be9b1488132742409b96478774edbbae` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.381531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.389714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] RBAC: Authorizing `identity:get_user(user_id=be9b1488132742409b96478774edbbae)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.391209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.393309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 134/278] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/users/be9b1488132742409b96478774edbbae => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:29.400332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.471981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.494886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9010-e16a-4372-955e-8cb18af32e5f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.503018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8989-e2bb-4443-9542-0b662452b042 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.534203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.534847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.535130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.535407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.540152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.540901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.541181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.541455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.542179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, user.id=be9b1488132742409b96478774edbbae, scope.system=all) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:29.542492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.543972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.546272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:29.549484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 135/279] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/role_assignments?user.id=be9b1488132742409b96478774edbbae&scope.system=all&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:29.550394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:29.552364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:29.553253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:29.554047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:29.555963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 145/280] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:29.562795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.603927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.698758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8f053-1d43-4ed5-bde0-3374d7bcf3ec None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.700476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c777f-01fc-44de-ac2e-cc4896b65ac4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.744230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.744929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.745337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.745691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.746912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.747402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.749138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.749345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.749766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.750184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.750995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:29.755657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 136/281] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:29.755775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.757143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.757253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.758731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.774404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 146/282] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:29.775559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.860419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:29.869074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d1fbe-3879-4679-983a-69c6b4e67581 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.883203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455412fd-96ad-4f52-8ebe-3bfe74a8ffec None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:29.907629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.908251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.908556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.908834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.909495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.910974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a5f03-5dce-4d5a-afe0-4e5c5a5175ba None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.920704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:29.920704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.921069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.921229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] PATH_INFO: `/v3/users/4f259225ac06429ab4f71c400e8c6aa4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.922422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] RBAC: Authorizing `identity:get_user(user_id=4f259225ac06429ab4f71c400e8c6aa4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:29.923852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e4a71-3f38-4cc5-8bd7-c7c9eb6685a9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:29.925603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 147/283] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/users/4f259225ac06429ab4f71c400e8c6aa4 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:29.926558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215cb-d4ea-48fe-93ef-794972ff322d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:29.926829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215cb-d4ea-48fe-93ef-794972ff322d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:29.927103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215cb-d4ea-48fe-93ef-794972ff322d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:29.930697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 148/284] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:29.933115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2215cb-d4ea-48fe-93ef-794972ff322d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:29.999900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:30.000907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 137/285] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:29 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:17:30.002300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.002592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.002869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.041616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:30.043263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:30.063493 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2215cb-d4ea-48fe-93ef-794972ff322d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:30.109830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:30.110586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.110831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.111105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.112410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:30.114020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:30.120464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 149/286] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:29 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:30.122566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:30.153544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 138/287] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:30.241639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f63a-5b85-473c-ade7-e60b6f28e0db None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:30.274840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:30.282322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:30.282996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.283282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.283591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/4f259225ac06429ab4f71c400e8c6aa4/roles/2e64c4905eb84ec0a1b824b3b076c5d0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.285549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, user_id=4f259225ac06429ab4f71c400e8c6aa4, role_id=2e64c4905eb84ec0a1b824b3b076c5d0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:30.289880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:30.384657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 150/288] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:17:30 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/users/4f259225ac06429ab4f71c400e8c6aa4/roles/2e64c4905eb84ec0a1b824b3b076c5d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:30.429711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:30.517891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:30.542880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4016-9b67-4b6e-96a7-8e8087bd500c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:30.582676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:30.583695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.584184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.584662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.596575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:30.601939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:30.606391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:30.607936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 139/289] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:30.609986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:30.727857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f493c2-3ea6-47c0-8a4c-c3bd387cd53e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:30.771060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:30.771715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.772010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.772292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.772974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:30.773287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:30.774682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:30.784695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 151/290] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:30.789957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:30.899567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534baccc-f79c-4540-9593-542ac67a4a12 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:30.935940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:30.936848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:30.937137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:30.937414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] PATH_INFO: `/v3/users/8ecb5256522a4e6f963f333fea473c8d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:30.938575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] RBAC: Authorizing `identity:get_user(user_id=8ecb5256522a4e6f963f333fea473c8d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:30.940075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:30.941956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 140/291] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:30 2022] GET /identity/v3/users/8ecb5256522a4e6f963f333fea473c8d => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:30.947662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:31.015844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:31.066152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7bdff-eb12-43a2-9a46-21da5cabf517 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:31.114905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:31.115536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:31.115822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:31.116154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:31.208636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:31.210019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:31.282240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:31.343205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 152/292] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:31.351276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:31.369925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:31.475988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea9f9-2f3a-424c-b45e-b3d62ab9cf78 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:31.520178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:31.521196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:31.521679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:31.522171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:31.523542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:31.525209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8921-97a5-4849-b004-bc7a4e921470 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:31.527070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 141/293] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:31 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:31.533748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:31.652099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1876a8-2966-4c78-acda-008f1f8c45cf None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:31.652757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1876a8-2966-4c78-acda-008f1f8c45cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:31.653247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1876a8-2966-4c78-acda-008f1f8c45cf None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:31.655337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 142/294] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:31.660785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:31.661144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:31.661451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:31.668835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096b68-a57f-4ff5-813d-7ee168f27dfb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:31.695380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:31.696803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:31.707677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:31.708294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:31.708579 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:31.708858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:31.709720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=8ecb5256522a4e6f963f333fea473c8d) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:31.710041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:31.711515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:31.718511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 153/295] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:31 2022] GET /identity/v3/role_assignments?user.id=8ecb5256522a4e6f963f333fea473c8d&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:31.816515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 143/296] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:32.160368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:32.187899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:32.277896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7890b-eee3-4ea9-bd6e-6d6b165935a6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:32.312033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:32.312664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.312944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.313219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.323312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:32.329281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:32.330180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:32.331035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 154/297] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:32.338085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:32.341779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:32.458892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c729-2664-4952-9e0e-5f6ad0dbd2a2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:32.494533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:32.495984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.496494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.497021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.498531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:32.499050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:32.500708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34fd37-323e-44d4-9c84-b95977d29242 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:32.510299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 144/298] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:32.517133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:32.603215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:32.610014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd4c9-8e8d-4ca0-af9f-381872ab9a3b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.610307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd4c9-8e8d-4ca0-af9f-381872ab9a3b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.610589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd4c9-8e8d-4ca0-af9f-381872ab9a3b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.612239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 145/299] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:32.621049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3892ca-9f6c-483a-b4fa-f473b0bccc8b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.621462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3892ca-9f6c-483a-b4fa-f473b0bccc8b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.622045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3892ca-9f6c-483a-b4fa-f473b0bccc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.632333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8679f4-9d4b-4241-b935-cc2be71e1610 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:32.641053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac3892ca-9f6c-483a-b4fa-f473b0bccc8b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:32.642381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac3892ca-9f6c-483a-b4fa-f473b0bccc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:32.670556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:32.671589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.672273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.672835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] PATH_INFO: `/v3/users/be9b1488132742409b96478774edbbae` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.674182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] RBAC: Authorizing `identity:get_user(user_id=be9b1488132742409b96478774edbbae)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:32.676034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:32.678380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 155/300] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:32 2022] GET /identity/v3/users/be9b1488132742409b96478774edbbae => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:32.684023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:32.729033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:32.746059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 146/301] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:32.755286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d2b7-039b-4633-a595-bc36c8233303 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.755690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d2b7-039b-4633-a595-bc36c8233303 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.756045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d2b7-039b-4633-a595-bc36c8233303 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.757712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 147/302] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:32.762960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd565-8f78-4369-822d-063a6acf43c7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.763522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd565-8f78-4369-822d-063a6acf43c7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.763979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd565-8f78-4369-822d-063a6acf43c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.784008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bb0cd565-8f78-4369-822d-063a6acf43c7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:32.785448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb0cd565-8f78-4369-822d-063a6acf43c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:32.821853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f29fe-4beb-449d-aae2-77994b5ceea5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:32.858311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:32.859019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.859332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.859654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] PATH_INFO: `/v3/system/users/be9b1488132742409b96478774edbbae/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.861074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=be9b1488132742409b96478774edbbae, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:32.861596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 148/303] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:32.862561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:32.863121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3a09-53b9-427e-a5c8-2e54cdcac4dc None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.863559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3a09-53b9-427e-a5c8-2e54cdcac4dc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.863974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3a09-53b9-427e-a5c8-2e54cdcac4dc None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.865326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 149/304] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:32.870450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:32.870734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:32.871012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:32.891810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:32.892986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:32.949233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 156/305] 10.222.0.43 () {58 vars in 1334 bytes} [Fri Aug 19 16:17:32 2022] PUT /identity/v3/system/users/be9b1488132742409b96478774edbbae/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:17:32.971834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 150/306] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:33.024885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.039475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.135134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412888-4915-457d-a98f-2b577e8ff365 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.148632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.171861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.172504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.172773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.173045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.174379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.175867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.177952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 157/307] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:33.184382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.214205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.261313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803881a-b048-4fac-9d24-ac2bbfe5c678 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.289611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.300847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.301479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.301767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.302029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.311169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5495c1-9709-460c-a327-6f5a31614158 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.313786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:33.319131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:33.320073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:33.320854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 151/308] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:33.321493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.355611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.356286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.356570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.356846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.358056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.359509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.430265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889db9fd-d8d8-4fd7-9f8c-246d7b9b9871 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.444457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 158/309] 10.222.0.43 () {60 vars in 1134 bytes} [Fri Aug 19 16:17:33 2022] POST /identity/v3/groups => generated 229 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:33.445585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.457717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.479044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.480102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.480642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.481228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.495036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:33.501518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:33.502444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:33.503711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 152/310] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:33.508938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.574892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf467-bff9-4a28-9e06-4a23a7fff045 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.624995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.626046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.626462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.626753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.627445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:33.627791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.628659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48687bde-78cf-4015-bef5-65df9f08a727 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.629210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.635870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.641877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 159/311] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:33.646975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.671567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.672447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.672876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.673294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.674101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:33.674552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.676179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.686854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 153/312] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:33.692066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.738175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.773034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbe952-0752-4d6a-a243-df647bb4ccc7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.815688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e57412-b331-4428-9020-3ed336619b6b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.820926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.821734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.822164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.822582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] PATH_INFO: `/v3/users/116da0734e2a436b9889a5b5929c560d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.838928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=116da0734e2a436b9889a5b5929c560d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.840377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.842169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 160/313] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/users/116da0734e2a436b9889a5b5929c560d => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:33.848028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.864853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.866082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.866512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.867215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] PATH_INFO: `/v3/users/4f259225ac06429ab4f71c400e8c6aa4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.868990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=4f259225ac06429ab4f71c400e8c6aa4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:33.871340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:33.874267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 154/314] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/users/4f259225ac06429ab4f71c400e8c6aa4 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:33.879869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:33.912282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:33.956892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9209-9a5a-4e38-a107-3d8fe599c0b5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:33.995788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:33.996412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:33.996718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:33.996973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:33.998686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, user.id=116da0734e2a436b9889a5b5929c560d, scope.system=all) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:33.998876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:34.000485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:34.007801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 161/315] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/role_assignments?user.id=116da0734e2a436b9889a5b5929c560d&scope.system=all&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:34.021174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9c4a-46cc-4118-aae7-5b3694065eb2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:34.031264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:34.064108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:34.064837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:34.065194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:34.065540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:34.145180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:34.146764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:34.250447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 155/316] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:34.256132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:34.362237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739117f6-2302-4ceb-acb1-6399ff512c44 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:34.385280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:34.397433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:34.398009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:34.398291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:34.398567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:34.399757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:34.401207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7777f-e3e3-4625-b579-cc59227a9659 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:34.403091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 162/317] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:34 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:34.409746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:34.436064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:34.516355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f455e0-b584-466b-bc39-6b29cac146bb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:34.551541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:34.552157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:34.552442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:34.552722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:34.553465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, scope.project.id=e9a5208ce33b4963a77373a37648fb98, user.id=4f259225ac06429ab4f71c400e8c6aa4) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:34.553788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:34.555241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e71558-264d-4daa-b32e-d29f72a8a241 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:34.562670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 156/318] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:17:34 2022] GET /identity/v3/role_assignments?user.id=4f259225ac06429ab4f71c400e8c6aa4&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:34.953367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680641d-aeab-4e40-b679-c6665eef13c5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:34.953745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680641d-aeab-4e40-b679-c6665eef13c5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:34.953922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680641d-aeab-4e40-b679-c6665eef13c5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:34.955385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 163/319] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:34.960261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:34.960553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:34.960829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:34.978546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:34.979747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:35.045327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:35.051524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 157/320] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:35.313284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680641d-aeab-4e40-b679-c6665eef13c5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:35.424580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680641d-aeab-4e40-b679-c6665eef13c5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:35.458940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:35.459596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.459877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.460149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.470412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4ca0b56f-8080-40c4-90db-dbb9684b7403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:35.475114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:35.476031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:35.476812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:35.477998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 164/321] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:35.481917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:35.501534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e60e55-f5d1-4807-be10-2d5e47aeedd9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.501821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e60e55-f5d1-4807-be10-2d5e47aeedd9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.502099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e60e55-f5d1-4807-be10-2d5e47aeedd9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.503432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 165/322] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:35.508409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac750-db8c-448f-b635-2a757f936fba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.508692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac750-db8c-448f-b635-2a757f936fba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.508963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac750-db8c-448f-b635-2a757f936fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.527655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-00cac750-db8c-448f-b635-2a757f936fba None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:35.528911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-00cac750-db8c-448f-b635-2a757f936fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:35.577026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:35.594000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3066-0174-4557-8431-d5e016d6dd1f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:35.603534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 166/323] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:35.635970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:35.636586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.636872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.637152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.637821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:35.638160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:35.639630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:35.648445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 158/324] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:35.653867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cac750-db8c-448f-b635-2a757f936fba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:35.754601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cac750-db8c-448f-b635-2a757f936fba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:35.787057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:35.787713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.787993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.788266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] PATH_INFO: `/v3/users/be9b1488132742409b96478774edbbae` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.789375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] RBAC: Authorizing `identity:get_user(user_id=be9b1488132742409b96478774edbbae)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:35.790815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:35.792625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 167/325] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:35 2022] GET /identity/v3/users/be9b1488132742409b96478774edbbae => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:35.798870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:35.862803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:35.887570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:35.903571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b466ed4-7dd6-4d91-90e3-4a1c5d519e0a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:35.939556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:35.940211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.940316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:35.940793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.940793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.941473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] RBAC: Adding query filter params (role.id=e8186d7e8f8445e18478415ad03750a0, user.id=be9b1488132742409b96478774edbbae, scope.system=all) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:35.941780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:35.943211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94581a-2de6-4072-b9f5-fef93756501c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:35.955126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 159/326] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 16:17:35 2022] GET /identity/v3/role_assignments?user.id=be9b1488132742409b96478774edbbae&scope.system=all&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:35.987968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898e0-9d49-4126-80df-32d91dee928c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.988308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898e0-9d49-4126-80df-32d91dee928c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.988530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898e0-9d49-4126-80df-32d91dee928c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:35.990208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 160/327] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:35.995461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:35.995765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:35.996044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.011067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627658af-c1a2-4b8f-9cb5-91ae5c0c9ebe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:36.017484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:36.018725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:36.051024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:36.051708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:36.051983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:36.052284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.053554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:36.055003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:36.056968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 168/328] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:36.063445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:36.096090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 161/329] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:17:36.174334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0498-4a49-4e82-8912-0fb50e259615 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:36.191373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:36.208693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:36.210000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:36.210000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:36.210000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] PATH_INFO: `/v3/groups` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.210431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:36.211886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:36.314949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 169/330] 10.222.0.43 () {60 vars in 1134 bytes} [Fri Aug 19 16:17:36 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:17:36.365804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:36.418920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:36.475046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d171390-ad13-4c1b-bef0-316c76824bba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:36.509664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:36.510299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:36.510585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:36.510858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.521117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:36.525845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:36.526705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:36.527505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 162/331] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:36.532975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:36.642330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465292-1900-45a7-bc7e-dd1fc6d9c03e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:36.677900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:36.678515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:36.678796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:36.679071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.679863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:36.680226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:36.681671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:36.691725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 170/332] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:36.697157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:36.809090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0da7f2-b2cb-4d83-ae9c-bef00acece9d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:36.821537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:36.845878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:36.846521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:36.846801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:36.847075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] PATH_INFO: `/v3/users/116da0734e2a436b9889a5b5929c560d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:36.848267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] RBAC: Authorizing `identity:get_user(user_id=116da0734e2a436b9889a5b5929c560d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:36.849735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535fcd6-d570-4d42-b3d1-5d4b1161a019 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:36.851656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 163/333] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:36 2022] GET /identity/v3/users/116da0734e2a436b9889a5b5929c560d => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:36.857438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:36.912566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:36.977851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eaa9b-7317-4fbb-b163-253bfb97e7a8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:37.016091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:37.016757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:37.017042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:37.017323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] PATH_INFO: `/v3/system/users/116da0734e2a436b9889a5b5929c560d/roles/2e64c4905eb84ec0a1b824b3b076c5d0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:37.018924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=116da0734e2a436b9889a5b5929c560d, role_id=2e64c4905eb84ec0a1b824b3b076c5d0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:37.020370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe8431-c650-4ceb-9c88-7680bb91d42e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:37.090983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 171/334] 10.222.0.43 () {58 vars in 1334 bytes} [Fri Aug 19 16:17:36 2022] PUT /identity/v3/system/users/116da0734e2a436b9889a5b5929c560d/roles/2e64c4905eb84ec0a1b824b3b076c5d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:38.840196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1248e-5295-463f-8163-df1c1d660f90 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:38.840703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1248e-5295-463f-8163-df1c1d660f90 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:38.840775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1248e-5295-463f-8163-df1c1d660f90 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:38.842697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 164/335] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:38.847750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e7be-a24e-4609-849e-6d5dd79fcbb1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:38.848170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e7be-a24e-4609-849e-6d5dd79fcbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:38.848339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e7be-a24e-4609-849e-6d5dd79fcbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:38.873077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0090e7be-a24e-4609-849e-6d5dd79fcbb1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:38.874622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0090e7be-a24e-4609-849e-6d5dd79fcbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:38.969498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 172/336] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:39.065638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccc75-cd31-4c31-8cd8-789c6691f6f0 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.065959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccc75-cd31-4c31-8cd8-789c6691f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.066199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccc75-cd31-4c31-8cd8-789c6691f6f0 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.067808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 165/337] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:39.073360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.073652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.073930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.096453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:39.097567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:39.129999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:39.174094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86803f77-fb17-4551-b01d-2c120a21bfff None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.174741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86803f77-fb17-4551-b01d-2c120a21bfff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.175212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86803f77-fb17-4551-b01d-2c120a21bfff None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.177024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 166/338] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:39.179509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 173/339] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:39.182375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.182866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.183367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.217178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:39.218686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:39.297284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 167/340] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:39.577037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:39.704348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:39.711532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda6bae-b73b-40b0-b64d-4e7a58c180bb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:39.756657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:39.757308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.757595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.757881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.777638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:39.783636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:39.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:39.785333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 174/341] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:39.795091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:39.831901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:39.908981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f393-f268-48fd-bfd8-ef0d2ff06463 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:39.910738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e8fe-11e0-4c57-af31-26082dadb968 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:39.922737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:39.954578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:39.955253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.955646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.955996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.957914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:39.958838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.959302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.959767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.969243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:39.973368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:39.974113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:39.974953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:39.975754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 175/342] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:17:39.976414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-66628c1b-3646-4c24-80fa-7b725c8bac48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:39.981099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:39.982258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:39.983217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:39.985419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 168/343] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:39.986840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414a6b-0bd5-407b-89e1-dc15151b8c65 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:39.987259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414a6b-0bd5-407b-89e1-dc15151b8c65 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:39.995501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414a6b-0bd5-407b-89e1-dc15151b8c65 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:39.995501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 169/344] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:39.996588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c414a6b-0bd5-407b-89e1-dc15151b8c65 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.087428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.112291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595467f-95fa-41f2-a5e8-50dd0833da54 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.144387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c414a6b-0bd5-407b-89e1-dc15151b8c65 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.157312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.157941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.158223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.158501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.159303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:40.159649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.161474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.173546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 176/345] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:40.174418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.194353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.195023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.195316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.195694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.196385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:40.196694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.198159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f589c-da01-4c1c-8d3d-73e6cbf35f86 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.211297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 170/346] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:40.212814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9161-187e-4df4-a78b-6cd656ecac26 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.213105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9161-187e-4df4-a78b-6cd656ecac26 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.213437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9161-187e-4df4-a78b-6cd656ecac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.237060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20ea9161-187e-4df4-a78b-6cd656ecac26 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:40.238807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20ea9161-187e-4df4-a78b-6cd656ecac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:40.267726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.301768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3aa18-112a-4bb4-aba4-31f6bfb58cc8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.325464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 171/347] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:40.327618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b5ba-48fe-4bc8-820f-fe12bb43c500 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.327912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b5ba-48fe-4bc8-820f-fe12bb43c500 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.328193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b5ba-48fe-4bc8-820f-fe12bb43c500 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.329802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 172/348] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:40.330618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6b5ba-48fe-4bc8-820f-fe12bb43c500 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.342807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.343462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.343777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.344058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.344739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:40.345048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.346446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.355237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 177/349] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:40.356316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.367079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.475366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6b5ba-48fe-4bc8-820f-fe12bb43c500 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.486818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17795a9-65f5-4337-afcc-a09c29a7e77d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.512665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.513247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.513566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.513803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.524904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.525827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.526301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.526795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.545741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.589309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.590785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d565a-ecb1-4b86-9bf4-c8aa03131514 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.601915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.604446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.613769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.707124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 173/350] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:40.713126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.713675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.714130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.736368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 178/351] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:40.737146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.738945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:40.740435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:40.808499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.821198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 174/352] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:40.822357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:40.864681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea665c5-dce9-4226-9649-718f40a282c7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.875383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:40.911279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.912662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.913238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.913750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:40.955109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d8c55-c296-48ac-8829-50c6bc6a5371 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:40.991645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:40.993406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:40.996649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:40.996649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:40.996840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:40.997117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.014032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:41.018901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:41.019819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 16:17:41.020594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:41.021521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 175/353] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:41.023359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.086647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.127868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 179/354] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:41.128725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.136752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.158084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d4dd-75d9-4d57-ba24-fc9cf4f5fb48 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.204558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.205206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.205492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.205758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.207588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.209051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeebac2-90d0-45d5-8c6d-b6825a2a60f3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.211025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 176/355] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.212534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1787-63b2-4da6-8651-eba3e0af1702 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.212534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1787-63b2-4da6-8651-eba3e0af1702 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.212790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1787-63b2-4da6-8651-eba3e0af1702 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.215174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 177/356] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:41.215174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb1787-63b2-4da6-8651-eba3e0af1702 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.241815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e03d7-b6a1-4213-8159-39e6caf33bdb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.288419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.289061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.289343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.289643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.290800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.292268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.295024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 180/357] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.295024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.336352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb1787-63b2-4da6-8651-eba3e0af1702 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.357826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.377863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.378482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.378757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.379053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.379797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:41.380104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.382186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.386294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.390814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 178/358] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.391512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.416131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3a446-8a25-4abd-8c3d-1cb2b706142d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.456708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.457382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.457637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.457911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.473487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:41.478324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:41.479278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:41.480119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:41.482747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 181/359] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:41.483775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.522172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9d6a4-c455-4968-9a57-e8f1ad53abc3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.563262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.563955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.564233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.564502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.565925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.567084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225a59d-5797-4d36-b20d-7c12da240a71 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.568759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 179/360] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.569884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.570170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.570442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.591070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:41.592341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:41.598602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03440-401d-4af2-a569-9ffa739a3a6d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.640204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.640839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.641119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.641393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.643715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.648793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.650459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.652193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.654383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 182/361] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.659348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.673993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 180/362] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:41.675107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.782530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9890952-6ead-455a-949d-c43f1ccbbcfb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.802786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656081a1-35a7-4dab-acc6-94016ab10307 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.827076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.828382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.828382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.828382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.829905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.831368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.834008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 183/363] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.836728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.858594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:41.859239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:41.861306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:41.861306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] PATH_INFO: `/v3/users/116da0734e2a436b9889a5b5929c560d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:41.861306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=116da0734e2a436b9889a5b5929c560d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:41.862363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:41.867589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 181/364] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/users/116da0734e2a436b9889a5b5929c560d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:41.868976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:41.923765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.926106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:41.970518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a48ed4-4834-4b23-9d86-4fe207e0ea61 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:41.992564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa00563-6f0e-446f-bef6-2678013ca4e0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.011890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.012509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.012788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.013665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.014418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.014731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.017439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.025540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 184/365] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.026185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.031908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.032610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.032850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.033127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.034277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.035777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.037370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 182/366] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:41 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.038135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.142300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae9811-0ac4-4487-a4c4-89c3fcc5a48e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.157123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8f1-550c-4732-bf3d-ec616958fa49 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.167616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.170334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.175692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.176304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.176615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.176891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.177626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=e9a5208ce33b4963a77373a37648fb98) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.177940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.179375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.184697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 185/367] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.185996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.190505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.191125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.191405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.191706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.192454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=456bc72209744ed7b6d753658a72f9e3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.192766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.194239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.200270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 183/368] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.202034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.321268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc942e06-bacc-4245-8707-2da20738d3f8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.365564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77292424-6fee-4780-91ff-ca0f7e4e3172 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.368057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.369523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.369523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.369523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.369955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] RBAC: Adding query filter params (role.id=2e64c4905eb84ec0a1b824b3b076c5d0, user.id=116da0734e2a436b9889a5b5929c560d, scope.system=all) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.370269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.373886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.397582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 186/369] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/role_assignments?user.id=116da0734e2a436b9889a5b5929c560d&scope.system=all&role.id=2e64c4905eb84ec0a1b824b3b076c5d0 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.398441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.419305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.420051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.420336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.420615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.447355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:42.457547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:42.458475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:42.459246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:42.460370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 184/370] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:42.463511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.528154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.534070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.611987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03d43-e388-47d4-be53-71bc4ff314cb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.626122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965d91a-a976-4f4f-b093-c456eddad813 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.665688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.666694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.667262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.667766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.667985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.668609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.668946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.669272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.669596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=456bc72209744ed7b6d753658a72f9e3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.670105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.671855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.680637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 185/371] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.681842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.819246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a838f0-5b27-4ad7-8262-6c4b3605c930 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:42.821402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.836671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.838156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.860750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:42.861746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:42.862311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:42.862791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:42.863716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:42.864252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:42.866006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:42.877407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 186/372] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:42.883743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:42.924098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:42.986506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 187/373] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:42.992401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.000647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bce9-6a2c-4cf5-bf6f-c58ba8440ea8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.038118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.039097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.039666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.040142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.074376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:43.115952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.117774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.189632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d9e0-4aed-4774-9f8c-909a6927826e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.229079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 187/374] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:43.235096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.273185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.274022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.274226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.274510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.275709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.277962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.283628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 188/375] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:42 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:43.286731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.315022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:43.317410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:43.363512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692723-d67d-4c70-923f-b819ce1e05cc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.406575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.407144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.407426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.407739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] PATH_INFO: `/v3/projects/d82f5f177bcb4be880a31087244a29b4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.408909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] RBAC: Authorizing `identity:get_project(project_id=d82f5f177bcb4be880a31087244a29b4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.410394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.413066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 188/376] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:43 2022] GET /identity/v3/projects/d82f5f177bcb4be880a31087244a29b4 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:43.417983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.452141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a4232-8a99-4891-ab23-59ee5b14dc27 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.506008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.506657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.506945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.507216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.510368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.511847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.518533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 189/377] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:43 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:43.524469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.606417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22e0f-0a02-4a6c-b101-4260a78ca67b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.663913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:43.666198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.666844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.669000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.679606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] PATH_INFO: `/v3/groups/175f62680f324d9bad7c51b8fcfd2634` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.679606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] RBAC: Authorizing `identity:get_group(group_id=175f62680f324d9bad7c51b8fcfd2634)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.679606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.680041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 189/378] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:43 2022] GET /identity/v3/groups/175f62680f324d9bad7c51b8fcfd2634 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:43.687799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:43.715075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:43.766227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f73a-39d2-4200-9af6-eb158b0b28a6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.800063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d40a5c-8a3d-4718-850c-493f978a96a2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:43.836861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.837524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.837817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.838100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.838832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] RBAC: Adding query filter params (group.id=175f62680f324d9bad7c51b8fcfd2634, role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=d82f5f177bcb4be880a31087244a29b4) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:43.839152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.840841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e893-86bb-4572-b33c-5177b45e1b17 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.848067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 190/379] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:43 2022] GET /identity/v3/role_assignments?group.id=175f62680f324d9bad7c51b8fcfd2634&scope.project.id=d82f5f177bcb4be880a31087244a29b4&role.id=80a461100b904c7e8f047066bc70bf3b => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:43.877028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:43.877671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:43.877958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:43.878236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:43.878987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=e9a5208ce33b4963a77373a37648fb98) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:43.879371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:43.880852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c05d6-14ec-4b19-9441-55e3d515c623 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:43.887098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 190/380] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:43 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 260 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:44.544799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915391-2a8c-469c-8c05-0ff4a2f15f49 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:44.545299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915391-2a8c-469c-8c05-0ff4a2f15f49 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:44.545372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915391-2a8c-469c-8c05-0ff4a2f15f49 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:44.546930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 191/381] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:44.556399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d6c1-10a9-4d82-8ece-c736942a6b24 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:44.556865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d6c1-10a9-4d82-8ece-c736942a6b24 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:44.556941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d6c1-10a9-4d82-8ece-c736942a6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:44.581447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6161d6c1-10a9-4d82-8ece-c736942a6b24 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:44.582723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6161d6c1-10a9-4d82-8ece-c736942a6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:44.590682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a853-8b8e-463f-a7dc-3a8fcd969559 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:44.590974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a853-8b8e-463f-a7dc-3a8fcd969559 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:44.591255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a853-8b8e-463f-a7dc-3a8fcd969559 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:44.593044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 192/382] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:44.599680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:44.600115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:44.600554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:44.623990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:44.625711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:44.702073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 191/383] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:44.702652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:44.712750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 193/384] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:45.137930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13ec7-c0cc-4afb-a1ec-537c8d561dd0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.138455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13ec7-c0cc-4afb-a1ec-537c8d561dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.138871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13ec7-c0cc-4afb-a1ec-537c8d561dd0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.140656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 192/385] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:45.143546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.145975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.146471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.146961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.171934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:45.173118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:45.244429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 193/386] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:45.245635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.273821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64fc31-7898-4353-8c2c-446a25c3f8a1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.303834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:45.343648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.344286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.344563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.344833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.368747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:45.374481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:45.375337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:45.376152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:45.378725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 194/387] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:45.384568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.421931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b112cc7-ef9a-4fd0-a058-b4d23a3a88e0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.441257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:45.493262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73538-e9e7-4bc3-a161-bf158909f7ff None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.532124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.532330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.532789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.533074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.533353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.533832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.534346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.534804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.535699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:45.536209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:45.537774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:45.548329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 195/388] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:45.550242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.560208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:45.565282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:45.566148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:45.566924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 194/389] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:45.567600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.644419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:45.679181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9fa6e-d64b-4df0-add7-9efd0a887b09 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.683059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c313cb-b91d-4698-978e-a7546b802318 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.701582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:45.720745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.721386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.721834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.722320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.723675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:45.725399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:45.727402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 195/390] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:45.733060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.733187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.733187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.733187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.733187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.746258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:45.753960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:45.754829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:45.755647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:45.759975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 196/391] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:45.760844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.864964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec5d6-1497-47bc-94cb-ce50919ad7af None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.876683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28095ead-826d-48c1-a0f9-ebc6c97ce7a6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:45.912760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.913689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:45.914013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.914327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:45.914612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.914889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.915100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:45.915587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:45.916081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:45.916659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:45.917150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:45.917594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:45.918940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:45.923616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 197/392] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:45.924468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.926030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:45.931419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 196/393] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:45.932468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:45.976611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.039041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762338c-d847-4801-acc9-dd8cf5cf4241 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.051768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea73e42-ceaf-4f60-8f60-253f93ec33cd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.073814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.074443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.074716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.074990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.076391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:46.076701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.078201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.086528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 198/394] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:46.088410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.090696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.091861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.092147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.092423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/groups/a3c58271618b4774b254b2b58a809959/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.094352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, group_id=a3c58271618b4774b254b2b58a809959, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.095878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755daf9c-5209-4aa2-8889-c65de01d7234 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.181859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 197/395] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 16:17:45 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/groups/a3c58271618b4774b254b2b58a809959/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:46.183459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260b83-26c4-4873-83d9-bd631ba62759 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.192653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260b83-26c4-4873-83d9-bd631ba62759 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.192653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260b83-26c4-4873-83d9-bd631ba62759 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.192653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 198/396] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:46.192653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260b83-26c4-4873-83d9-bd631ba62759 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.205969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b167d-6318-4057-8975-8c12e1a92c4e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.208134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.246769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.247123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.247924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.248279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.249692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.251312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e04de-5627-43dd-80cd-0c94dc3079fc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.257373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 199/397] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:46.258915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.259257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.259572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.280829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:46.283404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:46.307953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.339508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260b83-26c4-4873-83d9-bd631ba62759 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.367905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 200/398] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:46.368765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.390058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.390707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.390977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.391243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.392401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.393832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040d28-5837-47e8-a23d-49cea7c98d43 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.399536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 199/399] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:46.399536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa57c-e24d-4305-a3f8-593190b4682d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.399536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa57c-e24d-4305-a3f8-593190b4682d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.399536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfa57c-e24d-4305-a3f8-593190b4682d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.399536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 200/400] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:46.405724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.406057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.406446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.426563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:46.428057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:46.499802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.502658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c3a8f-16f7-47b4-a09c-54ae07984343 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.510342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 201/401] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:46.517665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.540407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.541332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.541719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.542113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.543788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.545939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.548199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 201/402] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:46.553985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.594735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.646331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716958a9-55c9-40dc-8d17-64615d16a6e8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.692829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.693491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.694075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.694362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.695847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.698270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.699996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 202/403] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:46.701372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.742145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12af53-9cf8-4c88-99a8-a164e2c899af None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.795054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.796434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.796888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.797306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/groups/a3c58271618b4774b254b2b58a809959/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.800866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, group_id=a3c58271618b4774b254b2b58a809959, role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:46.803241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:46.822738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c0817-7a14-4bdd-a6d0-ef02ad0c8aba None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:46.850403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.859780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:46.860448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:46.860729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:46.860998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:46.871106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:46.876553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:46.877494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:46.878287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 203/404] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:46.878964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.899832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 202/405] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 16:17:46 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/groups/a3c58271618b4774b254b2b58a809959/roles/c5d478f6f3b741fe926104027a3c5529 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:17:46.901205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:46.947381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:46.999569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d35d-f91a-479b-a3ba-39d1d3602e88 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.042865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.043657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.045041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.045041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3/groups/a3c58271618b4774b254b2b58a809959/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.046804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] RBAC: Authorizing `identity:create_grant(project_id=456bc72209744ed7b6d753658a72f9e3, group_id=a3c58271618b4774b254b2b58a809959, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.048327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.053373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39944fe-3e56-456d-9e5e-6bd39a98737a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.089372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.089998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.090334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.090609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.101532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:47.107043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:47.108139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 203/406] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:47.109338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.139798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 204/407] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 16:17:46 2022] PUT /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3/groups/a3c58271618b4774b254b2b58a809959/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:47.141461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.230179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:47.244443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6984bbe-7b38-4fa7-b204-865a95a2431d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.255686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:47.281170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.281790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.282069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.282342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.283020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:47.283320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.284773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.312081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 204/408] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:47.316754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.355780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a78f-3e58-4752-8ad6-baa231d36368 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.402604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.405094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.405094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.405094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.407733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:47.409320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.410927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.425849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 205/409] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:47.431668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.456690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd0acf-8532-4c6a-b751-4aab938037b4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.520710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.521344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.521628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.521908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.523805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.525286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.526865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 205/410] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:47.533196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.572272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:47.621941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587343c5-eb1b-4641-8d03-587bcca218da None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.634527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:47.682238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.682886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.683170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.683449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] PATH_INFO: `/v3/groups/175f62680f324d9bad7c51b8fcfd2634` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.685946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] RBAC: Authorizing `identity:get_group(group_id=175f62680f324d9bad7c51b8fcfd2634)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.687695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.690523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 206/411] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/groups/175f62680f324d9bad7c51b8fcfd2634 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:47.694988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.702967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da96a-4f02-40b0-919f-3064bbcea32a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.776746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.777395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.777675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.777953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.780033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.781507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.783159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 206/412] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:47.789452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:47.893345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06292-2062-42d0-aa1d-863a1d212ac4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:47.965043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:47.965690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:47.966490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:47.966770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] PATH_INFO: `/v3/projects/d82f5f177bcb4be880a31087244a29b4` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:47.968042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] RBAC: Authorizing `identity:get_project(project_id=d82f5f177bcb4be880a31087244a29b4)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:47.969525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:47.972438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:47.975576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 207/413] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:47 2022] GET /identity/v3/projects/d82f5f177bcb4be880a31087244a29b4 => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:47.977014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:48.006376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a53bc-b1f2-4c57-95e1-6dd8204fab01 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:48.064354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:48.065023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:48.065304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:48.065578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98/groups/a3c58271618b4774b254b2b58a809959/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:48.067788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5208ce33b4963a77373a37648fb98, group_id=a3c58271618b4774b254b2b58a809959, role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:48.069520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78120db5-6396-4658-b9b5-a20ee92e8ba1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:48.070276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:48.144267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed906-cbb4-4bfa-a473-d67a93d6773d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:48.160437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 207/414] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 16:17:47 2022] PUT /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98/groups/a3c58271618b4774b254b2b58a809959/roles/c5d478f6f3b741fe926104027a3c5529 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:17:48.181915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:48.182599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:48.182881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:48.183157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] PATH_INFO: `/v3/projects/d82f5f177bcb4be880a31087244a29b4/groups/175f62680f324d9bad7c51b8fcfd2634/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:48.185793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] RBAC: Authorizing `identity:create_grant(project_id=d82f5f177bcb4be880a31087244a29b4, group_id=175f62680f324d9bad7c51b8fcfd2634, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:48.187523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16896f5-53f0-4b9c-adf9-56edb485e572 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:48.256266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138a6f-c76c-42ca-9511-2b13b6598a82 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:48.256721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138a6f-c76c-42ca-9511-2b13b6598a82 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:48.257096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138a6f-c76c-42ca-9511-2b13b6598a82 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:48.258604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 208/415] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 16:17:47 2022] PUT /identity/v3/projects/d82f5f177bcb4be880a31087244a29b4/groups/175f62680f324d9bad7c51b8fcfd2634/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:17:48.258812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 208/416] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:48.264696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:48.269178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:48.269178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:48.286186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:48.287709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:48.367227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 209/417] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:48.658023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138a6f-c76c-42ca-9511-2b13b6598a82 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:48.789138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138a6f-c76c-42ca-9511-2b13b6598a82 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:48.833461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:48.834099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:48.834380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:48.834651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:48.847116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:48.851918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:48.852882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:48.854046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 209/418] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:48.859098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:48.912273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.004599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0cdb4-7205-4307-b49a-c5841e4fb67c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:49.056341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:49.056963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.057249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.057530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.058208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:49.058519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:49.060483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e89e9c-355d-4dd2-bb95-2de3099dd2be None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:49.076323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 210/419] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:49.081374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:49.097161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.177863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9c05-e1dd-492c-9dfb-554dc77ecf65 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.178050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9c05-e1dd-492c-9dfb-554dc77ecf65 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.178337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec9c05-e1dd-492c-9dfb-554dc77ecf65 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.179998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 211/420] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:17:49.193044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.193339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.193625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.206914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8467a0-3fc5-4fdb-8f55-0f4e90f8e98d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:49.224510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:49.225796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:49.254003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea610962-c266-4036-974e-eb7340729135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:49.254686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610962-c266-4036-974e-eb7340729135 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.254975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610962-c266-4036-974e-eb7340729135 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.255264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610962-c266-4036-974e-eb7340729135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.327883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea610962-c266-4036-974e-eb7340729135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:49.329448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea610962-c266-4036-974e-eb7340729135 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:49.359520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.361265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 212/421] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:49.433986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 210/422] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:49.440302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:49.485876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.584110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417b5a-2955-4f5d-b32a-37ed0d83cecd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.584570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451bf1d-6260-4f24-962d-dbfabae05404 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:49.584988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417b5a-2955-4f5d-b32a-37ed0d83cecd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.585505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a417b5a-2955-4f5d-b32a-37ed0d83cecd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.587027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 211/423] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:49.593329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.593652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.593931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.633289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:49.634494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:49.653230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:49.654614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.654963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.655255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.656591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:49.660481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:49.668569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 213/424] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:49.670665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:49.751034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 212/425] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:49.752688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:49.781502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.789124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553543b-fd79-472d-9554-c4f0ce6b0ebd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:49.789625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:49.826925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:49.827859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.828301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.828744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.830040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:49.832215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:49.834939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 214/426] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:49.840271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:49.863259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc512-05b3-4fb9-96da-e9d0c0de8473 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:49.899590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:49.900407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:49.900824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:49.901333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:49.914174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:49.919594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:49.920785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:49.921831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:49.927525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 213/427] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:49.930362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.009530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e9c95-329f-4323-a0e8-20cc77cf3b3c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.043938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.051857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e313985-8d46-4627-a65e-4d1252c9e873 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.090281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.091792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.093953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.094654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.096654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=e9a5208ce33b4963a77373a37648fb98) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:50.097167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.099695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.112064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 215/428] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:50.112968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.118208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.119156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.119671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.120148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.121042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:50.121547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.123607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.139259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 214/429] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:50.140973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.171927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.257635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d825-4faf-4bc9-a7f8-e76b8afeb68b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.298158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.299051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.299575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.300048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.302779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2692c-1a2e-440a-8922-518e49a5112f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.330408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.376312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.377303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.377802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.378274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.381369 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.382849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.392921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:50.398685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:50.403062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 16:17:50.404106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:50.406603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 216/430] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:50.412108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.504674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 215/431] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 16:17:50.507163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.531672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.553431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb979-0ab3-4002-b6f6-a6600ae3b319 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.576231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.592629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.593255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.593661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.593938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.594613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:50.594931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.596489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6192-8957-47cb-8bba-e3fc59583c28 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.605942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 217/432] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:50.608737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cab1-8348-4df2-b0c6-5b8f93eac92b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.608737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cab1-8348-4df2-b0c6-5b8f93eac92b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.608737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cab1-8348-4df2-b0c6-5b8f93eac92b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.609822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 218/433] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:50.614666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cab1-8348-4df2-b0c6-5b8f93eac92b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.626754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f6bd7-9121-4949-aab3-2820dd437369 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.665268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.666039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.666325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.666613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.667914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.670219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc13349-ff35-4f2c-aba3-562e880dd85b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.671977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 216/434] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:50.676433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.676433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.676433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.691976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:50.693184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:50.724608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cab1-8348-4df2-b0c6-5b8f93eac92b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.758023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 217/435] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:50.758593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.758866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.759151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.759431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.759885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.785338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.818816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:50.845989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.847612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ecd5-7a1d-4cd7-8ecb-fc0865f15491 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.863474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87881a8d-9bf3-4018-b510-c1c482df97e0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:50.897624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:50.898349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.898628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.898901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.900025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:50.901458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d26a26-2614-4eae-bd6c-d6429b4da66a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:50.908417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 218/436] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:50.908417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b2ac9-b8d7-42ce-9007-0dcee44fbe5c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.908417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b2ac9-b8d7-42ce-9007-0dcee44fbe5c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.908417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b2ac9-b8d7-42ce-9007-0dcee44fbe5c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.908417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 219/437] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:50.910463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b2ac9-b8d7-42ce-9007-0dcee44fbe5c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:50.959936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 219/438] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:50.966432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:50.966726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:50.966999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:50.984670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:50.985856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:51.016364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b2ac9-b8d7-42ce-9007-0dcee44fbe5c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.033738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.044768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.055364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.056003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.056289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.056408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 220/439] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:51.056581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.057139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.057297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=456bc72209744ed7b6d753658a72f9e3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:51.057613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.059100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.065817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 220/440] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:50 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:51.068378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.170614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ae9cb-80b4-42ad-82cf-fda34c836aa7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.208648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.209455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.209796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.210265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] PATH_INFO: `/v3/projects/456bc72209744ed7b6d753658a72f9e3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.211727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=456bc72209744ed7b6d753658a72f9e3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.213303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.214485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ccadb-a96f-4fd8-992a-b41e721067e4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.220817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 221/441] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/projects/456bc72209744ed7b6d753658a72f9e3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:51.222034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.260005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.261266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.261752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.262212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.275771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.277429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:51.286138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:51.294293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 221/442] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:51.295360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.345817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd15-09ee-4a1c-b63a-e2a322cff2e5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.350113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.383453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.384135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.384419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.384691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.385803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.387234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.388919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 222/443] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:51.389675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.402122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae271bc-16b2-408e-b812-ca443dc68d57 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.436954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.437538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.437823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.438093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.438751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:51.439051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.440468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.448260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 222/444] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:51.448934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.489056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddf54f-0990-4c65-9b79-5e75ab9887f1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.503115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.522916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.525253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.525253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.525253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.533998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:51.538761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:51.539712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 223/445] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:51.540645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.549705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214415a-8bb4-4c88-9d8e-da4e89dc0999 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.560387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.582912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.583532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.583816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.584087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.584807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=e8186d7e8f8445e18478415ad03750a0, scope.project.id=456bc72209744ed7b6d753658a72f9e3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:51.585116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.586545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.592151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 223/446] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=456bc72209744ed7b6d753658a72f9e3&role.id=e8186d7e8f8445e18478415ad03750a0 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:51.592981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.648708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bf149-8812-4f5c-b37c-f59ba6c90fa9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.689619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.690167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.690450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.690722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.723274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09a601-ca3a-4673-8baf-c1b8ccdb0d6b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.740930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.764172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.765022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.765345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.765701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.766448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:51.766825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.768373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.772383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:51.773820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:51.779360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 224/447] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:51.784490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.831850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:51.887694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 224/448] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:17:51.893790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:51.905222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ec79-4ec1-4632-b3cc-8e6f1b8ac38c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:51.951863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:51.952413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:51.952697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:51.952976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:51.987648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:52.014851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75dad1-4e65-4da4-b3ef-377c2c853932 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.033557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.035281 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.054593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.055225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.055578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.055841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] PATH_INFO: `/v3/projects/e9a5208ce33b4963a77373a37648fb98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.056973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] RBAC: Authorizing `identity:get_project(project_id=e9a5208ce33b4963a77373a37648fb98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.058405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.062101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 225/449] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/projects/e9a5208ce33b4963a77373a37648fb98 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:52.066980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:52.076147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:52.150834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 225/450] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 16:17:52.156457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:52.178757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22796-fe66-42d8-8acc-a33c96f41653 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.219719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.220288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.220569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.221028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] PATH_INFO: `/v3/groups/a3c58271618b4774b254b2b58a809959` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.221983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] RBAC: Authorizing `identity:get_group(group_id=a3c58271618b4774b254b2b58a809959)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.223427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.225370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 226/451] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:52 2022] GET /identity/v3/groups/a3c58271618b4774b254b2b58a809959 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:52.233317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:52.246835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:52.271777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87fa4-8519-443e-8cce-c8481ba9af63 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.306940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.307818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.308246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.308754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] PATH_INFO: `/v3/projects/d82f5f177bcb4be880a31087244a29b4` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.311594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d82f5f177bcb4be880a31087244a29b4)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.313123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.314782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 226/452] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:17:52 2022] GET /identity/v3/projects/d82f5f177bcb4be880a31087244a29b4 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:52.320435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:52.324016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:52.337352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdde1d-dc47-4453-8223-12688b4bb3e3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.377305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.377920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.378202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.378477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.379203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] RBAC: Adding query filter params (group.id=a3c58271618b4774b254b2b58a809959, role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=e9a5208ce33b4963a77373a37648fb98) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:52.379564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.380992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.386633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 227/453] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:52 2022] GET /identity/v3/role_assignments?group.id=a3c58271618b4774b254b2b58a809959&scope.project.id=e9a5208ce33b4963a77373a37648fb98&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:52.423059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26ede0-64d4-4791-b4df-f63c5e3585b1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.460104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.460752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.461033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.461307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] PATH_INFO: `/v3/groups/175f62680f324d9bad7c51b8fcfd2634` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.462506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] RBAC: Authorizing `identity:get_group(group_id=175f62680f324d9bad7c51b8fcfd2634)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.464001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8265e-0f26-4a85-9984-2c77eb0d5d94 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.465591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 227/454] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 16:17:52 2022] GET /identity/v3/groups/175f62680f324d9bad7c51b8fcfd2634 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:52.472556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:52.551284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:52.577670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20708919-2521-40bf-acfc-e4aea7c8a9ff None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:52.611602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:52.615108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:52.615108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:52.615108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:52.615108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] RBAC: Adding query filter params (group.id=175f62680f324d9bad7c51b8fcfd2634, role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=d82f5f177bcb4be880a31087244a29b4) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:52.615108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:52.615454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc540e-7474-43f6-95fd-65f7f85406a3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:52.621011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 228/455] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 16:17:52 2022] GET /identity/v3/role_assignments?group.id=175f62680f324d9bad7c51b8fcfd2634&scope.project.id=d82f5f177bcb4be880a31087244a29b4&role.id=80a461100b904c7e8f047066bc70bf3b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:54.886400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388dbe-100a-473e-b23d-4337b0e50b18 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:54.886896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388dbe-100a-473e-b23d-4337b0e50b18 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:54.887002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388dbe-100a-473e-b23d-4337b0e50b18 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:54.889218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 228/456] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:54.894139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47928-8c59-438e-8251-31022d4f6327 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:54.894972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47928-8c59-438e-8251-31022d4f6327 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:54.895455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47928-8c59-438e-8251-31022d4f6327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:54.924495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-53a47928-8c59-438e-8251-31022d4f6327 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:54.926024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53a47928-8c59-438e-8251-31022d4f6327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:55.010818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 229/457] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:55.084051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b9ea-cff8-48c4-ae85-45b187c909dd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.084674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b9ea-cff8-48c4-ae85-45b187c909dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.085183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b9ea-cff8-48c4-ae85-45b187c909dd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.086697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 229/458] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:55.092026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.092568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.093035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.120458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:55.122016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:55.199901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:55.209067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 230/459] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:55.419799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4b9ea-cff8-48c4-ae85-45b187c909dd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:55.514119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:55.556829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4b9ea-cff8-48c4-ae85-45b187c909dd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:55.607238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:55.618004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:55.618656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.619092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.619517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.639790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:55.642742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:55.668777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:55.669796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:55.670710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:55.670710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:55.670710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:55.670710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 230/460] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:55.677034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:55.745264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b667b9b-3bd1-4ad3-a034-eca07acc901c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:55.781625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:55.782186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.782467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.782739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.793022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:55.793298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fc5c-bf60-405b-b994-5b5524edcf86 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:55.795022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-95fad95c-eb5d-4023-a4c2-54fdfefdb9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:55.810998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:55.812163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:55.813059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:55.813059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:55.813059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:55.813059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 231/461] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:55.818113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c5de5-e224-49a8-a32c-c194c3272024 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.818706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c5de5-e224-49a8-a32c-c194c3272024 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.818706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c5de5-e224-49a8-a32c-c194c3272024 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.820038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 232/462] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:55.821786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:55.825039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6691f1f-bf7e-4c02-b83a-633d77467b90 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.826113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6691f1f-bf7e-4c02-b83a-633d77467b90 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.826380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6691f1f-bf7e-4c02-b83a-633d77467b90 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.831902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 233/463] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:55.831902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6691f1f-bf7e-4c02-b83a-633d77467b90 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:55.836827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:55.837603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.838020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.838553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.839337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:55.839798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:55.842254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe550d-9cc2-41e5-89c3-1e524e94dd2c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:55.855945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 231/464] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:55.857428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147e088-acde-41d5-b74e-ca01a7040091 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.857714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147e088-acde-41d5-b74e-ca01a7040091 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.857986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147e088-acde-41d5-b74e-ca01a7040091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.876876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e147e088-acde-41d5-b74e-ca01a7040091 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:55.878179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e147e088-acde-41d5-b74e-ca01a7040091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:55.886132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:55.939641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6691f1f-bf7e-4c02-b83a-633d77467b90 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:55.946998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 232/465] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:55.948298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.948581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.948858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.971581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:55.972765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:55.988049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:55.988646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:55.988923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:55.989194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:55.989935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:55.990269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:55.991662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:56.004357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 234/466] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:56.005305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.053467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 233/467] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:56.054283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.132943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e0ab-08d0-4b41-baee-f136f4649ea5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:56.137403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:56.159724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:56.216925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:56.217726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.218009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.218283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.218941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:56.219043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24ab1a-4ca7-4c37-91f7-ca747e8ad9e9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:56.220410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:56.257440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:56.258754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.258754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.258754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.259397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:56.260991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:56.348457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 235/468] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:56 2022] POST /identity/v3/users => generated 246 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:56.348457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.395517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 234/469] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:56 2022] POST /identity/v3/users => generated 248 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:56.397989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.594389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e0190-e3f4-46b5-82b7-44694c11594a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:56.618554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:56.623078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684853e-6958-4c2a-a68b-64cfb7ce9c01 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:56.648629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:56.649318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.649635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.649913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.665384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:56.667020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-42f3d032-d3bc-430a-abf3-2332144d1db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:56.688716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:56.689641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:56.690450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:56.690450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:56.690450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:56.690450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 236/470] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:56.692143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6bbd-6cc9-4253-9a7e-8fd561cfbbde None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.692143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6bbd-6cc9-4253-9a7e-8fd561cfbbde None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.692346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6bbd-6cc9-4253-9a7e-8fd561cfbbde None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.693677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 237/471] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:56.695328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:56.695458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6bbd-6cc9-4253-9a7e-8fd561cfbbde None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.696011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.696338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.696856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.710733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:56.712266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a332ea2f-ce28-4a47-9f85-ab5fac6f676f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:56.727270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:56.728408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:56.729402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:56.729402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:56.729402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:56.729402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 235/472] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:56.729864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.730151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.730418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.740481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:56.750032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:56.751227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:56.841364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 236/473] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:56.842228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:56.916093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6bbd-6cc9-4253-9a7e-8fd561cfbbde None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:56.977561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:56.980070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:56.982153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:56.982644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:56.983539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:56.985060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:56.986666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:57.016787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:57.017524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 238/474] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:57.021877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:57.047610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2307c-821c-4903-a434-c03497a8f635 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:57.112597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:57.113575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:57.114057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:57.114530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:57.115398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:57.116966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:57.118573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:57.135442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 237/475] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:57.142107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:57.163880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:57.203387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2b3d-e956-46b9-a8fd-d662583256ae None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:57.261552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:57.262175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:57.263778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:57.264495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:57.265834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:57.267986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:57.288973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa9c8-ddda-47fa-9c49-c1dce7218208 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:57.325846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:57.326452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:57.326731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:57.327004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:57.327696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:57.329197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:57.391522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 239/476] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:57 2022] POST /identity/v3/users => generated 248 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:17:57.391522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:57.407432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:57.414391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 238/477] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:17:57 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:17:57.538054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be12740-570e-429d-8149-fbebedb703f7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:57.595533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:57.595533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:57.595533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:57.595533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:57.595953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:57.595953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:57.599096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:57.631470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.sql.core [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 16:17:57.631470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 16:17:57.631470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [parameters: {'id': '5faf36c0e72b4c399e15f5e253f6a532', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 16:17:57.631470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Aug 19 16:17:57.651804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return ref.to_dict() Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:17:57.652775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application yield resource Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise self.value Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.commit() Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 16:17:57.654260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.flush() Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application compat.raise_( Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 16:17:57.655116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:17:57.657476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:17:57.659457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [parameters: {'id': '5faf36c0e72b4c399e15f5e253f6a532', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:57.661480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 16:17:57.663525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:57.665807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 240/478] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 16:17:57 2022] POST /identity/v3/roles => generated 144 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:57.671891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:57.800930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7688e-0df4-45b5-bfa4-b61b5f98f996 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:57.839630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:57.840662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:57.841642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:57.842132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:57.852870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c6b9ba00-1553-422c-8ca5-9cd8b551bc13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:57.859403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:57.860293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 16:17:57.861170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:57.863734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 239/479] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:57.869213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:57.990495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d9c1-01a5-4ee5-9825-1ad4452359ac None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:58.028836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:58.029838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:58.030323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:58.030815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:58.031715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:58.032251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:58.033842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ea520-888f-4dda-a545-3eee4ee999f4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:58.043336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 241/480] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:17:58.614968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c803db-5314-45c3-9279-175dfd8cfad5 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:58.615458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c803db-5314-45c3-9279-175dfd8cfad5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:58.615583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c803db-5314-45c3-9279-175dfd8cfad5 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:58.617082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 240/481] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:58.618492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35788ae4-5522-48cf-8597-695b822ca568 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:58.618785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35788ae4-5522-48cf-8597-695b822ca568 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:58.619064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35788ae4-5522-48cf-8597-695b822ca568 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:58.620627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 242/482] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:58.626561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:58.626846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:58.627128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:58.634752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:58.636665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:58.636665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:58.649356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:58.650954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:58.656234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:17:58.657443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:17:58.730370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:58.742463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 243/483] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:58.751040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:58.777978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 241/484] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:17:59.111766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.172051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.228319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b08e-ea8d-4f5b-a3f3-dacad765791f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.267518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.267518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.267518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.267518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.277578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:59.283914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:59.284791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:59.285563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 244/485] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:59.290724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.367903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:59.409175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb206d-7d7c-41cd-9760-9d1960b1fcbc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.419057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b3e0-a40b-40ce-860b-d923f8a29350 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.462395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.463030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.463311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.463618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.476196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:17:59.481416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:59.482301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:59.483083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 242/486] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:59.489575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.500805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.501426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.501706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.501979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.502710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:59.503025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:59.505825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:59.525845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 245/487] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:59.532437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.557912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:59.618732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004a7-9c97-4c1b-ba73-27e0ac50a114 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.657911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.659056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.660248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.660705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.661656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:17:59.662138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:59.663739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:59.673776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 243/488] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:17:59.678813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.807092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c47782-332a-42c4-871b-82f467abe0a0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.819140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:59.822465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfc98-7178-4200-a5c3-bd4e0ff70501 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:59.847877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:59.856687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.857546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.857890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.858171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.866380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:59.867030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.867342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.867655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.876348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:59.877948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:59.879460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:59.880942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-84f1fb36-06d5-406c-b626-f991aee020a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:59.893185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:59.894084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:59.894906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:59.894906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:59.894906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:17:59.894906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 244/489] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:17:59.895552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:17:59.897566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:17:59.899604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:17:59.899604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:17:59.899604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:17:59.899975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdfaf-47de-4cdd-9e72-edd5d9c02e00 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:59.899975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdfaf-47de-4cdd-9e72-edd5d9c02e00 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:59.899975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdfaf-47de-4cdd-9e72-edd5d9c02e00 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:59.899975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 245/491] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:17:59.904546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 246/491] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:17:59.908357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdfaf-47de-4cdd-9e72-edd5d9c02e00 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:59.908583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.012241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225201a-6a24-4499-b32f-86fd5ae730f8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.024606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdfaf-47de-4cdd-9e72-edd5d9c02e00 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.048025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.048878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.049260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.049598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.050308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:00.050772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.052108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.052291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.052907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.053288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.053663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.054405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:00.054813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.056332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0b2aa-da5f-4061-83af-d01057204f22 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.069240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 246/493] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:00.069432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 247/493] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:00.070720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.071120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.071359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.071697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.089859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:00.091705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:00.102502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.110902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.162683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 247/494] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:00.163466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.191357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b8b8e-88c6-483e-b2e5-3e8d0eb1e2fe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.240969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.241850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.242273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.242715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.253801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.256239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-43aa3c28-ed57-4e6d-926d-f5600567a002 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:00.274941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:00.276132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:00.277255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:00.278335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bef27-98c0-492c-b2ed-b8d55b49cc31 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.279964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 248/495] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:00.282618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce395-936a-455d-8d8e-e4ea4f5e3106 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.283057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce395-936a-455d-8d8e-e4ea4f5e3106 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.283472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce395-936a-455d-8d8e-e4ea4f5e3106 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.285368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 249/496] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:00.286212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ce395-936a-455d-8d8e-e4ea4f5e3106 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.321401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.322252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.322624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.323072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.331608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.333283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f01329a6-af66-4f8e-b3c9-82353512dc0a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:00.349381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:00.350486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:00.351595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:00.359025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 248/497] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:00.360254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.360681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.361059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.381072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:00.382403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:00.392021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.415597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.438788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ce395-936a-455d-8d8e-e4ea4f5e3106 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.459693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 249/498] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:00.460540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.488472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.489190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.489716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.490066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.490905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:00.491283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.493029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.538992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 250/499] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:00.539923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.580256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ebf53-abcf-4851-9688-d4970fdb5874 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.618639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.619381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.619929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.619929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.620741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:00.621055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.623262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.652590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ea3d-35c8-49c3-bd53-72e9a84c169f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.659060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.663042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 250/500] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:00.666825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.691626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.692260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.692544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.692815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.703104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9b445353-a1ee-4cfa-8f6c-2605ff5cb2b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:00.707905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:00.708867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:00.709655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 251/501] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:00.710707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df638a-0878-4718-be3e-fdf442bc93d8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.710707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df638a-0878-4718-be3e-fdf442bc93d8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.710707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df638a-0878-4718-be3e-fdf442bc93d8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.716394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 252/502] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:00.717769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df638a-0878-4718-be3e-fdf442bc93d8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:00.721184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.785861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994bd58-6592-4f7e-8156-787f8216471f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.819738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.820342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.820627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.820904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.822703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df638a-0878-4718-be3e-fdf442bc93d8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:00.857929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:00.858529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:00.858807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:00.859081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:00.884804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.887173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.888928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.924783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:00.926170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5552173-b87c-4b11-b536-5afce0cfdd97 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:00.927998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:00.988075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 251/503] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:00.988913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.023042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 253/504] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:01.024407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.024703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.024985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.042781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:01.044594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:01.084906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.089009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127558ad-8912-4904-ada1-6f3b2ed4eca2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.110670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 254/505] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:01.111536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.123236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.123849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.124134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.124409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.125082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:01.125387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.126777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.134703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 252/506] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:01.135504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.142788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.216826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9ad6f-61ed-4472-848c-35594fb8ffdc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.247952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a094e-09b6-4fe9-a3f4-ca56a20b81a7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.253698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.254334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.254616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.254891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.266244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:01.271270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.272180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:01.272960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 255/507] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.273619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.291078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.291772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.292061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.292326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.304697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.306107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:01.321586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.322487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:01.323312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:01.323312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.323312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:01.323312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 253/508] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.324103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.341826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.380036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.389093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b0a9-12db-45bf-967a-7aa444d72da2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.423173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.424315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.424595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.424866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.433548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a061049-fcc0-46d1-bd00-d3c05b38bba1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.435637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.437377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:01.452442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.453330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:01.454158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:01.454158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.454158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:01.454158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 256/509] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.454377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.472396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.472953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.473230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.473501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.484046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.485509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:01.500332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.501452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:01.502284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:01.502284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.502284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:01.502284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 254/510] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.502495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.558498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0874-443c-4773-949a-36f127a92cfa None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.567022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.592889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.593518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.593803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.594082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.594746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:01.595053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.596488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.602086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8e9b-3552-425d-bd4f-83c1738abd93 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.604251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 257/511] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:01.605194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.613914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.637358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.638503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.638787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.639065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.639735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:01.640044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.641659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.653254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 255/512] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:01.654050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.706143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cdf2-1deb-4a5a-b4a5-91c9998d59df None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.739111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.739698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.739987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.740289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.751395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.752884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.755503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac667-ff6f-466d-9685-f6715da7a182 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:01.767727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.768787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:01.769625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:01.769625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.769625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:01.771625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 258/513] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.772600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.782094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.790872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.791497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.795259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.795259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.795259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:01.795259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.795259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.805762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 256/514] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:01.806577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.835446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:01.877424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca075f3-f483-4d83-bbfb-da0ad303b0d1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.905669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94752-bda6-41e6-b821-92405b62f225 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:01.910597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.911201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.911508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.911779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.912817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:01.913125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.914899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.927024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 259/515] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:01.927845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:01.939592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:01.940219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:01.940501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:01.940774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:01.950850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:01.952336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:01.965681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:01.966704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:01.967580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:01.967580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:01.967580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:01.967580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 257/516] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:01.967580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.012126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.027709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2b695-da16-4634-baf5-dddc140f62ce None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.045655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.063066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.063717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.063998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.064272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.070925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.072444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.073254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e6ea-7c67-4a0d-9025-086ee4423f7c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:02.084635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:02.085660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 260/517] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:02.091904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.106627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.107259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.107574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.107850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.108489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.108795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.110172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.121396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 258/518] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.123133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.189087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e93b9-faf0-4a8e-81e5-5e96fff12996 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.217565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.221061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.221546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760d1c6-fd7b-40ad-bfdd-b2b7d09ccc91 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.221691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.221960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.222253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.228757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.230207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:02.241719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:02.242739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:02.243649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 261/519] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:02.244105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.256447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.257079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.257366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.257645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.264828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.266223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:02.277450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:02.278865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 259/520] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:02.280066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.285966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.346090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afda0d-e4df-4d38-a41b-99b8a8527c4a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.380250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.380862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.381146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.381422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.382068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.382375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.382462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4fc09-798c-4431-a86b-4fb2d15bcded None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.383782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.395357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 262/521] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.396166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.423829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.424434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.424716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.424986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.425686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.425980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.427411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.444739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 260/522] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.445534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.464534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.497763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.501460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149628-6879-4ad5-a685-8fded7eff6c1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.533943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.534482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.534759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.535043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.535693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.537113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.543436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b2e81-68a1-4452-bedc-692ec7dc16ee None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.578502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.579101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.579433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.579735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.580422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.580729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.582166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.594149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 261/523] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.604651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.628814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 263/524] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:18:02 2022] POST /identity/v3/users => generated 247 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:02.629744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.679157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.706770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e26d02-7aaa-42bf-a478-6939cba4a08a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.744187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e94f-869e-4d54-b14b-6dcd01690af0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.745113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.745836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.746185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.746526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.747594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.747983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.749556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.775889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 262/525] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.776876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.784847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.785557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.785696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.785971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.794612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.796340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:02.810648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:02.812055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 264/526] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:02.813337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.832734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.901429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523755af-2e04-4ead-8308-856990caa9f6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.921521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9021cf-5781-400a-87fd-d32576818344 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:02.938648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.939313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.939629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.940038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.940931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.941231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.942695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.945694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:02.948999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 263/527] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.949884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:02.969675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:02.970308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:02.970590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:02.970865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:02.971844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=e1d6b286abb74772860b17905c9fa3f0) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:02.972162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:02.974061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:02.982222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 265/528] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/role_assignments?user.id=e1d6b286abb74772860b17905c9fa3f0&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:02.983402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.075796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b83-10fc-460f-82da-1cc8ff5b3b08 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.098248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.120531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.121458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.123125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.123675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.130042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e995-ed1a-4195-aea5-1d39c170c718 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.187005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:03.192738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:03.224543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 266/529] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:03.230560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.235845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.239007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:03.240519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:03.402922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 264/530] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:03.405742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f42f-07a6-4f67-981f-a76c2959e03b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.413597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.452183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.453275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.453848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.454358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.459565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.558438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.563211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c0b7-c17d-4156-aab6-3fda30a62d9b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.600683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.601711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.602237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.602775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.604909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:03.606876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:03.615149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:03.616957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:03.634003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:03.634953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:03.635814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:03.635814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:03.635814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:03.638392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 265/531] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:03.644268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.758044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c5ef-3786-47ba-ab42-6b7df1a78a1c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.799756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.800738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.801219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.801689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.802555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:03.803056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:03.805811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:03.821308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 266/532] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:03.828093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.847831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.874714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 267/533] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:03.884490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:03.948080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa110e-ac68-46c5-ae81-01c7da5d5434 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:03.973968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:03.987182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:03.988279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:03.988766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:03.989252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:03.998631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.000929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:04.021961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:04.022886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:04.023771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:04.026193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 267/534] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:04.032261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.131402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea9da-5b00-49ca-b223-0d0546a09443 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.143721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001344-3172-4585-8cfe-18c16dc019ff None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.155959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:04.191230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.191955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.192239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.192583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.207217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.209335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:04.226335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:04.227695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:04.228518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:04.228518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:04.228518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:04.228518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 268/535] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:04.232567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.233446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.233929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.234049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.234513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.235431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:04.235967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.237662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.262491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 268/536] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:04.270135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.407060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:04.419280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04cc61-a1a9-426b-9441-c6550f26f3c0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.423556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c636f-e802-4495-abb9-a5a16489ffea None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.462560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.463550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.464050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.464557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.466020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ecf96598f034c928195d02f98059469) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:04.466592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.468366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.471826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:04.474873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 269/537] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/role_assignments?user.id=7ecf96598f034c928195d02f98059469&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:04.496440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.497136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.497426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.497707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.498394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:04.498704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.500249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.519022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 269/538] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:04.525934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.650446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac97ba-62dd-4ee4-bc23-493fa8d4803d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.689517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.690099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.690384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.690660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.698279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.699777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:04.712284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:04.713198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:04.714492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 270/539] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:04.721624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.845121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b33305-3bc3-4eb2-916c-2f8bed63c952 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:04.891991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:04.892609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:04.892891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:04.893163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:04.893870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:04.894180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:04.895638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0d112-cb6f-487e-b138-4520d5205c2f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:04.915688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 270/540] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:04.922591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:04.987931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:05.033633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c94e5-0985-433c-bb13-6e7357e3f81c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:05.088229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:05.088855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.089137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.089414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.090151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=1bef4155d39e4781b8b4e3cba14a5a80) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:05.091055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:05.092595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405aa54-c47d-4e8f-aa49-11d2bcd37424 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:05.098745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 271/541] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:04 2022] GET /identity/v3/role_assignments?user.id=1bef4155d39e4781b8b4e3cba14a5a80&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:05.168414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1f53-d00d-40e6-ac4d-ede45398bdf8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.169371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1f53-d00d-40e6-ac4d-ede45398bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.169653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1f53-d00d-40e6-ac4d-ede45398bdf8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.171430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 271/542] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:05.176930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830ca9-fcf6-44e4-9e0d-fd0102e576f0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.177219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830ca9-fcf6-44e4-9e0d-fd0102e576f0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.177499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e830ca9-fcf6-44e4-9e0d-fd0102e576f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.197519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e830ca9-fcf6-44e4-9e0d-fd0102e576f0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:05.198722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e830ca9-fcf6-44e4-9e0d-fd0102e576f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:05.258642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c55d-657a-4119-b737-809470870ddf None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.259127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c55d-657a-4119-b737-809470870ddf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.259127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c55d-657a-4119-b737-809470870ddf None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.260436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 272/543] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:05.270410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.270705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.270979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.295455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 272/544] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:05.295805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:05.297087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:05.297576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713794b-56cc-4a4a-9ad6-836cfe587a06 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.298080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713794b-56cc-4a4a-9ad6-836cfe587a06 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.298547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713794b-56cc-4a4a-9ad6-836cfe587a06 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.304370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 273/545] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:05.306436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:05.306603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.306939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.307632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.328535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:05.329909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:05.397390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:05.445163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 274/546] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:18:05.449956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 273/547] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:05.600161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:05.730952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea17e62-cd36-4c0e-95fb-75ab206e4fbc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:05.742959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:05.791246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:05.791911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.792195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.792471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.804122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:05.808876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:05.810771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:05.811876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 275/548] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:05.818611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:05.877373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:05.923069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6e33-eb5c-4b34-b794-b21bf8545616 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:05.960116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:05.960445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7018c6-a803-45f6-91c6-6b803f34dc99 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:05.960882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:05.960991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:05.961268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:05.969504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:05.973312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:05.978069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:05.985041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 274/549] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:05.985993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.020733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.021666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.022166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.022691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.023721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.024220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.025900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.039516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 276/550] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:06.040682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.097698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3acaf-2f53-4280-b6a4-89117d515061 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.134513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.135110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.135399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.135932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.147374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:06.152017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acce63f-7dd1-44f5-902a-72549bf3436e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:06.152285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:06.153190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:06.154006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:06.158585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.158705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 275/551] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:06.160094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.193996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.195149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.195664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.196130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.196981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.197480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.199397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.213791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 277/552] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:06.214964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.223894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.268559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe0a3-fd2b-4574-913d-71c53baf02d5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.305946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.306514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.306798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.307071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.320762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.322403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.325692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163487-a28a-4b3d-a6a2-1b5aab741c16 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:06.342724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:06.343999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:06.345163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:06.345163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.345163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:06.347632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 276/553] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:06.349625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.371560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.373016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.373453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.373861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.374671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.375112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.376860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.386384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 278/554] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:06.388041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.419825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.492321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f8935-19dc-4b33-8777-9eb126ff80bf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.503635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40558749-7e8f-4e7c-be6f-b4ce2a8b81d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.506685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.542458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.543412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.544133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.544513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.545089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.545876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.546294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.546704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.547503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.547943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.549485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.557727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.560452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.562312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 279/555] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:06.563365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:06.585343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:06.586311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:06.587172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:06.587172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.587172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:06.591634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 277/556] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:06.593765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.664402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.681603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c350fb-536b-47ed-82cb-d4bd83115afa None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.719852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.720459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.720793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.721067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.733000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.733771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94936c0-475b-48c3-8dca-0932ccb16a4a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.734469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:06.749559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:06.750510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:06.756749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:06.756749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:06.756749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:06.756749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 280/557] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:06.756749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.782403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.783199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.783800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.784107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.791943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.793394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:06.805472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:06.806432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 278/558] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:06.807351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.839226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.866552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a3b1-c518-499c-af71-cb89857bf9c6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.902491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.903666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.903948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.904213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.904853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.905160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.906534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197c87-667b-4dc4-a499-3931c65af3ff None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.914792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:06.924655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 281/559] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:06.924820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ab6e-e868-412c-83d0-a4358de91fcb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:06.924925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfbf7c-844a-405f-8346-01b77fc961d7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.924925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfbf7c-844a-405f-8346-01b77fc961d7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.924925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfbf7c-844a-405f-8346-01b77fc961d7 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.924925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 282/560] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:06.924925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfbf7c-844a-405f-8346-01b77fc961d7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:06.963452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:06.964094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:06.964375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:06.964645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:06.965285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:06.966267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:06.967817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:06.986313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 279/561] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:06.987096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.038338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfbf7c-844a-405f-8346-01b77fc961d7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.074281 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.074482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.075409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.075724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.076000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.076721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:07.077057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.078521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e8ec-ab36-4a15-99bd-18afb38a1a96 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.093777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb2998-c1b9-47a4-838b-872f47dd4f63 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.096170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 283/562] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:07.097402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.097691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.097970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.116059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:07.117262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:07.136342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.137825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.138280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.138795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.146317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.148092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:07.160991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:07.161970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 280/563] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:07.163261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.173147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.189279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 284/564] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:07.189945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.285602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ace2-6f3c-44de-be96-d4c389877877 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.293106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b026e-fc50-40d7-8db4-1bcda75f3d1b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.320366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.321004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.321286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.321561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.329784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.331236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.337586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.338219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.338503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.338778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-723e771c-a203-4bbe-8717-9296948f8944 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:07.343439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:07.344345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 281/565] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91134-14f6-48cd-9f75-6dfb8c3f06c1 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.350106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91134-14f6-48cd-9f75-6dfb8c3f06c1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.350810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91134-14f6-48cd-9f75-6dfb8c3f06c1 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.351531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 282/566] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:07.352894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91134-14f6-48cd-9f75-6dfb8c3f06c1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.355877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.357395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.358821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:07.375497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:07.376466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:07.377313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:07.377313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:07.377313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:07.379868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 285/567] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:07.381374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.422526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.469879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91134-14f6-48cd-9f75-6dfb8c3f06c1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.484588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f2d6-a2af-44e0-a9e4-d6132df42a6f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.503438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.504414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.504414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.504645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.505370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:07.505676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.507101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d458d52-663b-4983-9c6f-bf29bd681213 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.518428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.519032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.519314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.519617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.520344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:07.520655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.522076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.524339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 283/568] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:07.525679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f62-18b2-4976-9336-369faa683455 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.525969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f62-18b2-4976-9336-369faa683455 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.526241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f62-18b2-4976-9336-369faa683455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.544514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-57f34f62-18b2-4976-9336-369faa683455 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:07.545179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 286/569] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:07.545701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-57f34f62-18b2-4976-9336-369faa683455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:07.546005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.599977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.611585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 284/570] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:07.612462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34f62-18b2-4976-9336-369faa683455 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.637841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.646264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1615-fe04-47d1-877c-afe2668bb1cd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.682285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.682900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.683181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.683453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.684146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:07.684470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.686120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.701909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 287/571] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:07.701909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.738639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34f62-18b2-4976-9336-369faa683455 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.775339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.776004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.776280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.776556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.791507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:07.797449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:07.798348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:07.799168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:07.801331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1266-e5cd-429e-9a74-92d4666572fb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.801746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 285/572] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:07.802724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:07.846479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.847098 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.847382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.847693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.858337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.876471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:07.911919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ede1d-5572-4014-bd6b-edbefd95e9b9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:07.922919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.924428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.945119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:07.945756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:07.946045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:07.946324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:07.957073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:07.958562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:07.973305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:07.974339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:07.975221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:07.975221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:07.975221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:07.975221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 286/573] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:07.975221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.024833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 288/574] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:08.025963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.077733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3854-9c7a-4c75-ad9b-bc1ead0574df None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.079276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.083243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.110877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.111692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.111987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.112261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.118894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.120569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.125184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d7b9-31f8-4f0a-a332-175592cdef8a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:08.132388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.137830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 287/575] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.138709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.160493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.161093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.161375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.161678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.162343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:08.162650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.164078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.176965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 289/576] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:08.176965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.238913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3efe42-1a29-45f7-bab7-5e0c60088c06 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.271764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f5362-220a-4268-bd82-22ddff058a25 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.273298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.273932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.274216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.274492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.284670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:08.288644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:08.289743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.295894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 288/577] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.296777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.306981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.307643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.307922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.308196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.308839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:08.309670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.311329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.320736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.323074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 290/578] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:08.323803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.400238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aaea6-91a8-49e8-9afb-8d7a42adbdcc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.425470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f813b-10bd-40c1-8287-d3710f6f975b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.433266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.433893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.434826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.435337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.446381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.447881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.460679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.461277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.461557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.461825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.462501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:08.462725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.463708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:08.464574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:08.464574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.464574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:08.464752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.464752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.464876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 289/579] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.465200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.475824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 291/580] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:08.476985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.517695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.545487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.571010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525b16-1477-466b-b61e-ca815a3d72dc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.578292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e8b7-48f2-4972-9712-19af9f853f11 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.605149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.605819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.606769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.607047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.614352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.614960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.615263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.615557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.616223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:08.616530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.617971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.618155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.619736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.626879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 292/581] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:08.627701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:08.639864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.641000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:08.642060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:08.642060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.642060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:08.642060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 290/582] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.642060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.741317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.744245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1e3e-3950-441d-8baf-1f832785ee23 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.744572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cd1f-3b93-4e43-8e00-271ee0a90205 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.769414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:08.777530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.778127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.778240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.778461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.778750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.778841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.779033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.779306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.779394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:08.779718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.781079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.785956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.787427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.792422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 291/583] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:08.793222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:08.799032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.799956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 293/584] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.800821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.900251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1136e-7457-48dc-84be-55d18a7043b0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.906468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59194a-4813-4065-9cdf-fda4841fc6b1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:08.933153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.933769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.934053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.935012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.941336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:08.941995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:08.942279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:08.942559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/45a6ed02312a474785f158860216c19f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:08.945117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.946562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.956853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=91692048695d4f96ad3ef501c8863b33, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:08.958288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:08.961028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:08.961909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:08.962775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:08.962775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:08.962775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:08.962775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 294/585] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:08.963222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:08.978033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.022697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 292/586] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:08 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:09.024507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.064460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f49f5-38e4-4a85-8a3b-00da8052172b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.065070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.104860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.105584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.105778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.106648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.107347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.107891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.109315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.128363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 295/587] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.128363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.149868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c066bb-8c2a-4f38-b209-3d0916df8247 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.193705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.194347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.194625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.194919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.202178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.203681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.210043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:09.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:09.223428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 293/588] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:09.224385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.250865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121ea5c-149a-4f8b-8bf4-eeac2b034e76 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.287595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.288205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.288493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.288765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.289463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.289770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.291196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.305252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 296/589] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.306782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.320408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.326905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9747e-f3b8-403d-8331-9ef9274f6c8b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.370623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.371234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.371565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.372419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.373055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.373494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.374721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.387527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 294/590] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.387527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.432032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fbf03-ad89-4133-b048-bdb6f67fe290 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.466319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.474019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.474678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.474963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.475471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.484513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.486077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.495787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4ab6-aea4-4cf9-a058-62199ef9f812 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:09.499571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:09.500677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 297/591] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:09.502037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.537856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.538470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.538755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.539033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.539761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.540065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.541517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.555221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 295/592] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.555895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.575941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.614534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878385d-3578-45f3-96ae-9abc97dc1330 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.653923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.654579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.654869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.655149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/e1d6b286abb74772860b17905c9fa3f0/roles/45a6ed02312a474785f158860216c19f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.663293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b88c7-5eb4-4438-b288-3e06c3686d1f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.670796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=e1d6b286abb74772860b17905c9fa3f0, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.672282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.698119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.698758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.699043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.699323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.707279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.708775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:09.721400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:09.722367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:09.723300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.729458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 298/594] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:09 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/e1d6b286abb74772860b17905c9fa3f0/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:09.730387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.785729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.841589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:09.858276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8f1d-b25d-4643-a17c-da077f8a34e2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.875747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfa575-8116-4414-bd22-438026fe89dc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:09.900787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.901703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.902134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.902567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.903875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=c98929303e0e420e85db06478eb3d8f8) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.904233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.905730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.913788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 299/595] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/role_assignments?user.id=c98929303e0e420e85db06478eb3d8f8&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.914825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:09.916009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:09.916826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:09.917256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:09.917739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:09.919723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:09.921205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:09.922941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:09.951058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 297/596] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:09.956730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.085354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39bf07-6e7e-433a-aac7-2e1bb49fe0a8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.096335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:10.126569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b682-95fa-4e9f-b6c5-a02687879a88 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.135463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.137042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.137518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.138216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.139581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:10.144718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.145206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.182726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 300/597] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:10.190241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.193968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.194932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.196208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.196584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.201958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:10.216873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.218669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:10.247660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:10.248967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:10.250049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:10.250049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:10.250049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:10.251550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 298/598] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:10.257190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.381282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca2e2-c84f-419a-b505-77c5c3fa2938 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.440577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cba26a-c793-48f0-b9c4-55181b888c4c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.460899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.461542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.461825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.462097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.485343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.486827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.505183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.505801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.506083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.506357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.507009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:10.507313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.519509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:10.519686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:10.520777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:10.521866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:10.521866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:10.521866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:10.521866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 301/599] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:10.522473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.541879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 299/600] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:10.551145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.571859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:10.651103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:10.712241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3579249-8bbd-4cce-8a81-9b62fa0f82d1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.751919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.752914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.753324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.753612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.761761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.763842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:10.776383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:10.777252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:10.778548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:10.779236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d865-9300-4c7a-8c6d-386a74bc2061 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.779324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 300/601] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:10.783316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.828882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.829508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.829797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.830078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.830735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:10.831046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.832652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.845461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 302/602] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:10.851006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:10.892553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d901eb-e263-4eed-97c9-e61f46d37cce None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:10.899887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:10.928817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:10.929353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:10.929634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:10.929940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:10.930927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:10.931418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:10.933127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:10.951586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 301/603] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:10.953196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:11.035839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:11.062452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e18d-72be-44a2-9cb5-fce177552518 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:11.078540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ab00-1b0d-4687-8837-6a1b79b26ccc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:11.120613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:11.121279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.121588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.121868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ecf96598f034c928195d02f98059469/roles/45a6ed02312a474785f158860216c19f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.128652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:11.129528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.130091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.130572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.136491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=7ecf96598f034c928195d02f98059469, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:11.138669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907c565-a8ad-46b1-8792-78328af79c0c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:11.139314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:11.141619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7fce56d1-0811-4d05-a21e-e9fcb32ba576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:11.154519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:11.161199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 303/604] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a69e-084a-4ae5-9f45-d9c7ade4c749 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.162083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a69e-084a-4ae5-9f45-d9c7ade4c749 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.162678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a69e-084a-4ae5-9f45-d9c7ade4c749 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.163765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 304/605] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:11.164590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a69e-084a-4ae5-9f45-d9c7ade4c749 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:11.255396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 302/606] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:10 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ecf96598f034c928195d02f98059469/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:11.257642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.257938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.258225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.297858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:11.302418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:11.318041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a69e-084a-4ae5-9f45-d9c7ade4c749 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:11.330741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:11.401711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:11.402341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.402622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.406937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.407741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:11.408060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:11.409553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:11.416874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:11.438888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 305/607] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:11.448570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:11.454504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 303/608] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:11.559146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842607a-688b-44ba-9a7a-ed4527bb09ec None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:11.597042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:11.597764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.598054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.598331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/1bef4155d39e4781b8b4e3cba14a5a80/roles/45a6ed02312a474785f158860216c19f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.614368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=1bef4155d39e4781b8b4e3cba14a5a80, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:11.615969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4e97b-0ba7-4797-815e-835ea3200f88 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:11.726801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 306/609] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:11 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/1bef4155d39e4781b8b4e3cba14a5a80/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:18:11.738338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:11.850089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab6709-f5b9-4da9-9c7a-14d09aec9c7b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:11.857625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda0ec-2998-476b-ba5a-0754aec1ab9b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.857945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda0ec-2998-476b-ba5a-0754aec1ab9b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.858181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda0ec-2998-476b-ba5a-0754aec1ab9b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.860074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 307/610] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:11.865505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.865763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.865980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.894919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:11.896016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:11.896715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:11.900229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:11.902001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:11.908837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:11.924682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:11.929939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:11.930957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:11.931830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:11.943226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 304/611] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:11.946581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:11.962381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:11.992687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:12.025522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 308/612] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:18:12.065350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63c5b-1cff-4702-8473-0165de5815a5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.103717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.104353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.104639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.104913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.105589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:12.105927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:12.107310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90784c2d-ba85-4cbb-8e37-66a1d289ca4a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:12.116311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 305/613] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:12.122509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.174071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ad35-e955-469b-898f-380673c7f421 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.174655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ad35-e955-469b-898f-380673c7f421 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.175108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ad35-e955-469b-898f-380673c7f421 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.176642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 306/614] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:12.181564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.182095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.182548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.220969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:12.222558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:12.266690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe058a-637e-4297-9463-7bacf021e39b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.322182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.323428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.323940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.324412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.336492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:12.338286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:12.345734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:12.355146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 307/615] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 16:18:12.361827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:12.373937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:12.374860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:12.376221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:12.376221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:12.376221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:12.376221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 309/616] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:12.376221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.413037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:12.536341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb7c94-ab0c-4c31-acf1-35644903671a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.558276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e91ff-7fae-4056-8870-6da971fcc8d2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.599285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.599942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.600411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.600692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.601338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:12.601649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:12.603036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:12.617968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 310/617] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:12.624171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.648235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.648898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.649186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.649466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.665942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:12.671590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:12.672554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:12.673395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:12.677530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 308/618] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:12.678407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.740000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:12.742129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:12.756753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a975-461e-4582-a41c-471d590a0c70 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.786852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522b63-ced9-4035-be3c-426197c36969 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.804275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.805196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.805479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.805752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.816100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:12.817551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:12.828412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:12.828969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:12.831033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:12.832469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:12.833379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.833379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.833379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.833615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 311/619] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:12.833615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.843733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:12.850466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:12.851631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 309/620] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:12.853067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:12.947810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7785c-bb76-45a7-92a5-4d7d03f1f8bc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:12.989789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:12.990490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:12.990887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:12.991249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:12.992028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:12.992399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:12.993836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.001127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13c57-5e29-495d-a3bb-0451af96e154 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.007435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 312/621] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:13.008411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.021711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.023789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.047604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.048701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.049136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.049560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.050958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:13.051417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.053410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.076423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 310/622] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:13.077545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.134922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b5a78-baf4-4728-ba21-1920c266f24b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.186102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58940a5-3413-470b-9557-b535665f411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.187271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58940a5-3413-470b-9557-b535665f411c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.187743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58940a5-3413-470b-9557-b535665f411c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.188166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58940a5-3413-470b-9557-b535665f411c None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.188932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83eaf5-d214-46dc-840f-e9e544a055d4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.189158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58940a5-3413-470b-9557-b535665f411c None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:13.189608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58940a5-3413-470b-9557-b535665f411c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.192344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58940a5-3413-470b-9557-b535665f411c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.207623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 313/623] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:13.207623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58940a5-3413-470b-9557-b535665f411c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.234050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.235048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.235532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.235975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.247911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.249703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:13.267263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:13.268236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:13.269105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:13.269105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.269105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:13.275826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 311/624] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:13.276926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.293938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.311397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.334767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58940a5-3413-470b-9557-b535665f411c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.381382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.382259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.382754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.383223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.416853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f955d-5954-4b64-8c79-bcb135f7b5f5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.456830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.458940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.463278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.463955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.464247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.464528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.479523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.481932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:13.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:13.501250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:13.502099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:13.502099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.502099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:13.504178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 312/625] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:13.505161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.559296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.595998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.612073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 314/626] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:13.613420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.621302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b166-99d9-4750-a69c-aa38c3dadca2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.657371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.658005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.658278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.658555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.659248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:13.659587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.660972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.679064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 313/627] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:13.679064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.736110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb110-9e25-4079-be18-981ac317e71c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.772983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.773585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.773860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.774134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.774771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:13.775078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.776551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0bc4-196f-4985-b448-27a1a6ed266f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.786079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f908-30d1-4ca7-b790-9384746d03b2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.788291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 315/628] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:13.794086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95732-55d4-49f2-a570-237307ce8253 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.794370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95732-55d4-49f2-a570-237307ce8253 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.794644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d95732-55d4-49f2-a570-237307ce8253 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.795926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 316/629] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:13.796616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95732-55d4-49f2-a570-237307ce8253 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.828679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.829320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.829608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.829882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.830326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.839104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:13.841266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.843255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:13.858219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:13.859222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:13.860161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:13.860161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:13.860161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:13.860161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 314/630] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:13.864366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:13.912201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d95732-55d4-49f2-a570-237307ce8253 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.953370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:13.954312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.954739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.955129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:13.964042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:13.967291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:13.976434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93aeb0-014f-4d88-b4d5-370dff6d0400 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5f658e62-7345-44ca-bcfc-41bfbde69117 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:13.981811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:13.982767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 317/631] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db7ee-629b-4d04-a8ab-c78c7018e946 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:13.984438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db7ee-629b-4d04-a8ab-c78c7018e946 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:13.985250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db7ee-629b-4d04-a8ab-c78c7018e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.002283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a76db7ee-629b-4d04-a8ab-c78c7018e946 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:14.003395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a76db7ee-629b-4d04-a8ab-c78c7018e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:14.011928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.012692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.012972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.013244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.021449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.022898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:14.033952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:14.035022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 315/632] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:14.036387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.069493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 318/633] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:14.070740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ad69-ee82-418f-90fa-cfbc795b8b14 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.071022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ad69-ee82-418f-90fa-cfbc795b8b14 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.071294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ad69-ee82-418f-90fa-cfbc795b8b14 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.072712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 319/634] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:14.073231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850ad69-ee82-418f-90fa-cfbc795b8b14 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.089507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.098436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.139645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fdf61-0333-4966-ada6-3a6a0e630ab1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.175116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.175753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.176036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.176315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.176955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:14.177403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.178780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.182220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850ad69-ee82-418f-90fa-cfbc795b8b14 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.196152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 316/635] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:14.196152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.222937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.223575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.223864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.224142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.224878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:14.225194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.226653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03f83-b079-4b13-ad7a-2da5867d8bcc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.249845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 320/636] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:14.251035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.251332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.251644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.269313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:14.270500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:14.303343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508679-dded-47e0-964f-60955cf57dac None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.318380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.346566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 321/637] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:14.346566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.357713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.359434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.360005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.360583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.361437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:14.361837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.362941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.363409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.382282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 317/638] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:14.383164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.469126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34975aa-fc63-4139-b715-0c0a342a2d04 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.495878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b14d5-2ae3-40d2-bec2-eac454c76122 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.503921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.504550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.504832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.505105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.511915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.513533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:14.524536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:14.525638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:14.526810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:14.530818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 322/639] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:14.531673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.536537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.537157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.537439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.537718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.581702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.611338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.612812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.613683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.644379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd03c-e72f-45bc-9ca6-1548354744dc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.678329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.678971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.679256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.679565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.690071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:14.695248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:14.696473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:14.697574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:14.702338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 323/640] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:14.702922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.714234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 318/641] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:14.715065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.784198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.803568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a3cf9-5091-4e16-8fd1-e9e49e3c07d5 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.815166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8df29-c3a3-42fa-9175-db7a001b8cf2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.831808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:14.837126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.837783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.844578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.844578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.849080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.850093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:14.850579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.850700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:14.850979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:14.851253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:14.851974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:14.852286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:14.853704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:14.864757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:14.865899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:14.867050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:14.867050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:14.867050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:14.867266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 319/642] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:14.867266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.873263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 324/643] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:14.873998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:14.966224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312bf58-e0fe-4916-b947-2095d16febdf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.973087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8a85-1e8f-47f4-b006-fe63d7e69f7c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:14.994698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.001117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.001823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.002177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.002524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.008049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.008655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.008946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.009220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.009886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.010194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.011611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.014024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:15.019025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.020146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:15.021257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:15.021968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 325/644] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.021968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.023772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 320/645] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.024686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.068651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.122836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0824ca-5a69-4f2e-a2a8-247dc8688a7b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.123003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468488d-153a-49b4-bc2b-9175b4e28fc2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.156209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.156376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.156834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.156937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.157119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.157218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.157390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.157486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.158114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.158427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.159887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.165504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 321/646] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.166275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.167992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.169504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:15.185354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.186851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:15.187970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:15.187970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.187970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:15.191705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 326/647] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.192555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.238905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.289723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8324d-817d-4a3c-bd16-fc13fcdc419b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.311453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.323736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb5fd2-87a7-44e6-b075-0184f62442ec None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.331778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.332207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.333015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.333015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.333413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.333720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.335103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.348677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 322/648] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.349747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.368417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.369063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.370331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.370629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.382456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.383970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:15.400000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.401219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:15.402310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:15.402310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.402310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:15.402310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 327/649] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.402310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.470285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7071a6-0905-4f20-b179-d3d9d58a0e83 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.487065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.506822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.507569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.507854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.508132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.508804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.509116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.509361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656a4a-e688-4c33-87ae-9d7e950b07c1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.510499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.524832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 323/650] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.525722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.549329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.549942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.550227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.550515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.551159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.551469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.552907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.565490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 328/651] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.566146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.577195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.640583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f9398-ec5a-43cc-bcfc-8bea80ab5e66 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.673755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819534d-4243-4c9f-b5bd-d981cc97e89d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.676784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.677178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.677532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.677867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.689970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.691429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:15.702799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.703912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 324/652] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.705164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.716615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.717312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.717663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.718008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.718731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:15.719109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.720595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.737765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 329/653] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:15.737765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.748077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.806639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:15.815571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ae033-b34b-418d-b262-fd4a278ed34e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.845090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d712-f149-404c-9b21-331225a2ef75 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:15.854754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.855497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.856551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.857150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.868185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.869731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.882248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:15.882980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:15.883341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:15.883717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:15.885682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.886821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:15.887814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:15.887814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:15.887814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:15.887814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 325/654] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.888143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.896476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:15.897959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:15.910499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:15.911640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 330/655] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:15.912594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:15.994445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.007382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2c12-5e3c-486c-853c-9ceb3598d063 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.021588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f95fa-bf1e-4ae7-acf3-9655aa406ae6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.048786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.049406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.049690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.049963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.050667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:16.050977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.052450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.055756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.064110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.071276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.071276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.071276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.071566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 326/656] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:16.071566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.078883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.080534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:16.093753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:16.094883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:16.096142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:16.098623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 331/657] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:16.104174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.185917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ddad-9b13-4fdb-8a5c-7cc26b5b54ad None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.216475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d66c-fec1-474e-91e7-050e106ad233 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.225924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.226545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.226831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.227137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.227822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:16.228132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.229525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.240972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 327/658] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:16.241765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.254661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.258637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.259546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.260219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.260506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.261251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:16.261565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.263957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.281343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 332/659] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:16.281343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.332561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.360569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f0f05-c2c9-419b-9fbf-2ddf4a26a0a0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.398217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.399174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.399453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.399759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/c98929303e0e420e85db06478eb3d8f8/roles/45a6ed02312a474785f158860216c19f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.407949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dcfe-7fa4-4b1c-af44-793543fffc9a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.416450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=c98929303e0e420e85db06478eb3d8f8, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.417906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.443742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.444531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.444918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.445285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.446142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:16.446534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.448089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.469225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 333/660] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:16.471630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.503534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 328/661] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:16 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/c98929303e0e420e85db06478eb3d8f8/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:16.503534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.591168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.629202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0ca8f-c08a-4388-a665-21414010c3d3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.640117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.656170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9d96f-8820-479b-8e2c-27160f0286f0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.679891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.680536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.680820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.681095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.692677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.694620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.701469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.702116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.702398 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.702675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.703412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=e1d6b286abb74772860b17905c9fa3f0) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:16.703757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:16.705183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:16.710257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:16.711241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 16:18:16.720204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:16.720775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 329/662] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/role_assignments?user.id=e1d6b286abb74772860b17905c9fa3f0&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:16.720775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.720909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 334/663] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:16.723736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:16.860152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fcd5b-0074-4fa7-8f83-6c26532e2858 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:16.890083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:16.909133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:16.910130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:16.910613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:16.911083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:16.948229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a2a38-7102-4198-b678-32509eaa9938 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.009549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.010180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.010466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.010741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.011510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:17.011987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.015308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.019137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.020149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.042695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 335/664] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:17.049020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.088224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.160502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 330/665] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:17.166503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.190947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf4e8-4699-4025-9ae0-58bcc307859b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.193567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.234818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.235471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.235781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.236057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.299817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9f4b2-2daa-4702-85d8-72b1e7d70584 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.320161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.322669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd33c68-4e5e-4be4-b5e2-585b65995e74 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.341840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.342496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.342780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.343052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.355081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.357425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.358046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-992227c2-bebc-4394-bb90-18b4888b90d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:17.381543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:17.382558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:17.383443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:17.383443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:17.383443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:17.384874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 331/666] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:17.385970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfd68-1e0c-48ea-b077-586f3bc589fd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.386251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfd68-1e0c-48ea-b077-586f3bc589fd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.386523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bfd68-1e0c-48ea-b077-586f3bc589fd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.388765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 332/667] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:17.393141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bfd68-1e0c-48ea-b077-586f3bc589fd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.463761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 336/668] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 16:18:17.465917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.466404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.466852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.485385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:17.486866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:17.489991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.519533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bfd68-1e0c-48ea-b077-586f3bc589fd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.556408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.557040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.557402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.557739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.558515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:17.559526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.561488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.565860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 337/669] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:17.566979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.593961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 333/670] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:17.599129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.633391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.689271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855d72e-c746-46d5-a0e7-a0e484504106 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.728824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.730013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.730470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.731448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.743841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.745587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:17.762822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:17.763842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:17.764727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:17.764727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:17.764727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:17.771975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 338/671] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:17.773779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.855500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0545-8b0d-4835-9ff8-2b3af89171c2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.880823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268c493-4025-45d3-8e00-bedaf4682e7f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:17.890739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.894895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.895567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.895853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.896130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.898274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:17.904278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.905735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:17.916940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:17.917841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:17.920069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 334/672] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:17.920558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:17.925144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:17.926064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:17.926560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:17.927083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:17.927999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:17.928935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:17.930567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:17.952323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 339/673] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:17.952497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.036702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a1481-d135-4288-9503-1fb4ee475cd2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.067241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147b76-6a03-4be9-9337-640bf8505c73 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.072293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.073227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.073707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.074199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.085892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:18.091709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:18.092617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:18.093424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:18.095881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 335/674] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:18.097061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.105562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.106379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.106876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.107212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.108356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.108356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.109809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.124483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 340/675] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:18.126169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.160323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.161217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.208484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d726c-ee3a-4c82-9a67-b07bf848df38 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.241484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce03c-4494-4a43-8a6f-c41a6c91a705 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.243515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.244401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.244980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.245448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.253107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.254845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:18.267152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:18.268098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:18.269001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:18.275733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 336/676] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:18.276463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.281439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.282590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.282590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.282764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.283347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.283696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.285146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.295103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 341/677] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:18.296034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.388175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8b8-9c75-4591-8d41-1e95c667f8e0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.405494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.411039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.428265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc4fd-3bc9-41ab-ab4e-b982ccf67014 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.430500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.431500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.432298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.432836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.433788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ecf96598f034c928195d02f98059469) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.434882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.437074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.444220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 337/678] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/role_assignments?user.id=7ecf96598f034c928195d02f98059469&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:18.445469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.500590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.501960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.502654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.504305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.505287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.506130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.509596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.540305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 342/679] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:18.541960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.659212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeef58f-284f-4597-a2c9-bea7a5243737 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.711993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.712637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.712929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.713203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.716186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf595b-c5a2-4d79-9cd4-ff5d9948b2a1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.728897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.730330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-90f84579-f2fd-4a6c-8942-74a925c25aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:18.748949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:18.750170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:18.751179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:18.751179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:18.751179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:18.751179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 338/680] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:18.752011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac7fe-4ec3-4426-baf3-687e206cd357 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.752981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac7fe-4ec3-4426-baf3-687e206cd357 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.752981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac7fe-4ec3-4426-baf3-687e206cd357 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.753832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 339/681] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:18.756704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ac7fe-4ec3-4426-baf3-687e206cd357 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:18.766076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.766827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.767204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.767613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.769049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=1bef4155d39e4781b8b4e3cba14a5a80) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.769471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.771004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71292-a845-4913-9d72-0557e5d6d88b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:18.783573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 343/682] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/role_assignments?user.id=1bef4155d39e4781b8b4e3cba14a5a80&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:18.785115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.788844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.789315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.811100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.824697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:18.831460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:18.846826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:18.954335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ac7fe-4ec3-4426-baf3-687e206cd357 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:18.963170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 344/683] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:18.991972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:18.992584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:18.992865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:18.993141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:18.993790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:18.994098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:18.995530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:19.008825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 340/684] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:19.014572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.122908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc5650-ce8b-4500-b3e2-c99c5204713a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:19.160683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:19.161410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.161761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.162104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.170685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:19.172253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:19.189566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:19.190758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:19.191920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:19.192771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 345/685] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:19.198030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.269979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.273116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:19.332960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:19.344094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208e1c-d825-4deb-ae68-d7742be1111c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:19.381692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:19.382313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.382589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.382866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.383749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:19.383950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:19.385386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42f00b-b7ad-442e-8b50-0647cba807b5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:19.405013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 341/686] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:19.406207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec521-e94b-42fa-ba47-5d42d6635057 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.406500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec521-e94b-42fa-ba47-5d42d6635057 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.406781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec521-e94b-42fa-ba47-5d42d6635057 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.407755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9791c-4762-4f7c-b2c9-337b3e4279a8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:19.412643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 342/687] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:19.413408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec521-e94b-42fa-ba47-5d42d6635057 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.452166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:19.453209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.454401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.454917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.468387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a9603a97-618b-4acd-9ca1-da714a28af89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:19.475260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:19.476383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:19.477391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:19.485412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 346/688] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:19.485412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.485412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.486529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.504907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:19.506230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:19.545319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec521-e94b-42fa-ba47-5d42d6635057 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:19.567938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:19.584703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 347/689] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:19.585982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.598985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:19.604857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.604857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.604857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.627624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:19.721580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:19.725690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:19.798716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aed9a-0995-4aed-b2b0-f0fc73abbbd3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:19.870724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:19.872507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:19.873054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:19.873515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:19.874391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:19.874881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:19.880276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:19.898887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 348/690] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:19.904176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.912083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 343/691] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:19.913149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:19.966232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:19.969381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.015394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35eb0-26d0-4052-a2ab-2f8757015ce6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.021766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7b815-36fa-40ca-988a-d8d9f6e5324f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.052608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.053457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.053576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.053816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.063232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.064402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.064880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.065340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.066368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.068012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.078039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.079873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:20.083055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:20.084095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:20.085054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:20.085054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.085054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:20.085054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 349/692] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:20.085499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:20.099410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:20.100694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:20.101683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:20.101683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.101683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:20.103453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 344/693] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:20.104418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.198607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753958-0517-4f88-8c72-9976bb009c37 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.206324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.218646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.221890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4885b0-c5a4-481d-9155-a4a7368e44f6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.240506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.241158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.241443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.241718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.252930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.254431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.264631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.268231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.268231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.268231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.268231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:20.268231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.269157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.285578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 345/694] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:20.286913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:20.393396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:20.394407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:20.395303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:20.395303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:20.395303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:20.399036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 350/695] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:20.399927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.422756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745556-33fc-4687-9845-8370f536c4d0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.466554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.467173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.467456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.467760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.468707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:20.469017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.470412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.487567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 346/696] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:20.488706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.514421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.532351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47729c-a6df-4552-8cbe-8878c0893dc9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.575710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.576799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.577239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.577679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.585929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.587764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.600143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363befb3-26e9-4495-a6a1-025735b0fdff None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:20.601886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:20.602897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:20.603908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:20.606680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 351/697] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:20.607792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.629931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.638440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.641503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.641503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.641503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.641503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:20.641503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.642280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.659538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 347/698] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:20.659538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.728785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec97d-3cb9-415c-bc88-2b52fdc432f8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.742752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.761661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3106be6-48ef-4cf0-92f0-780262a163b5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.766978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.767622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.767903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.768173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.768807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.770246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26d5a-1e2c-4b0a-8a8f-0e7ce2e44b93 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.798928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:20.799567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.799847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.800120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.800850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:20.801160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:20.802693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:20.820427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 348/699] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:20.821253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.838832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 352/700] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:18:20 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:20.841403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04529-c33b-4d07-9095-30392468a1d0 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:20.841760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04529-c33b-4d07-9095-30392468a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:20.842095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04529-c33b-4d07-9095-30392468a1d0 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:20.847647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 353/701] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:20.847647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca04529-c33b-4d07-9095-30392468a1d0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:20.947688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:20.967808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db571f2-be85-4149-86d3-0ca52c6a4d88 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:20.990620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca04529-c33b-4d07-9095-30392468a1d0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.010444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.011092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.011374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.011694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.020598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.022061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.023897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7a6775ad-9e3f-4952-8eba-16645e57c8e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:21.034315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:21.037799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:21.038742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 349/702] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:21.039336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.039336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.039533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.039609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.039692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.039768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.039841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.063091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:21.064588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:21.122157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.123648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd77e1-63cc-4466-966a-a3b1bc6a1c41 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.148963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 350/703] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:21.150248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.225016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.264778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 354/704] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 16:18:21.266535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fae8-3b59-480d-ab76-2ffdbc9a3f0b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.267025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fae8-3b59-480d-ab76-2ffdbc9a3f0b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.267567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172fae8-3b59-480d-ab76-2ffdbc9a3f0b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.269258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 355/705] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:21.270619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172fae8-3b59-480d-ab76-2ffdbc9a3f0b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.271874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322caa3-fbcf-461d-9e58-ef26197dc1d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.315412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.328003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.328906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.329420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.329743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.330887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:21.331544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.333733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54cb0c-d1aa-4074-aa92-1208ae52af28 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.360223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 351/706] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:21.362529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.363051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.363796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.389414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:21.391734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:21.412990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172fae8-3b59-480d-ab76-2ffdbc9a3f0b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.452718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.453352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.453633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.453921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.464388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.466750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.476549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 352/707] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:21.477420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:21.485735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:21.486874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:21.487965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:21.487965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:21.487965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:21.493546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 356/708] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:21.493546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.531284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.600974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcabe38-cfc6-4496-8233-2c8780cc7fcb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.620042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.630411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf8de-4004-420c-99b8-8bf4a89d2fc0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.639473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.640215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.640556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.640889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.641678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:21.642050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.643849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.655511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 353/709] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:21.655511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.698758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.700049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.700342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.700619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.701239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.702653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:21.726009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:21.727167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:21.728051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 357/710] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:21.738378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.829713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9323-7a0b-4de5-a92c-3d45a7e6d764 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.867850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:21.871040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.872011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.872476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.872758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.873412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:21.873720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.875457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.878520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a019-f908-4314-8041-6e6ae12859c3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:21.889078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 354/711] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:21.889953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.924559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:21.925435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:21.925730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:21.926011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:21.926659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:21.927055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:21.929675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:21.935887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 358/712] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:21.936994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:21.942541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:22.022278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fa3a7-0eba-49b1-bd83-7973fb4efe73 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.051805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311310-4f71-46b6-9e91-e9359ad9fc54 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.071121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.071818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.072106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.072410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] PATH_INFO: `/v3/services/network` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.073281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.075274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:22.091837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:22.093449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:22.094523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:22.099513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 355/713] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:22.099513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:22.099708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.099708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.099708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.099708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.108700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.110341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:22.123293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:22.124397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:22.125475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:22.131238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 359/714] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:22.131238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:22.145944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:22.216827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfabba-91bf-485a-985b-0ad17ad23c28 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.227729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:22.250947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a90ad3-4f2f-48bb-90f7-6147a650abe0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.255871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.256867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.257489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.258198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.259128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:22.259685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.261149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.268136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 356/715] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:22.269048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:22.305870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.306796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.307274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.307735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.308660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] RBAC: Adding query filter params (name=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:22.309169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.311146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.322870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 360/716] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:22.329600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:22.389120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9da2a-7a2a-46ee-9fb9-b589cd73b083 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.426338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.427082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.427461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.427863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.429149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:22.429607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.431168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.446441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 357/717] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:22.452742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:22.495920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:22.519920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:22.544378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ec83-1b0c-4968-9411-caa8eab26344 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.580144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644109-bed1-498e-8959-8a9c862e6b36 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:22.587890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.590891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.591290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.591688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.592523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] RBAC: Adding query filter params (type=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:22.592943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.594586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da298f-cfd4-431b-b394-50cd7e0cd277 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.602529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 361/718] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:22.624081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:22.624879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.625255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.625627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.626560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=c98929303e0e420e85db06478eb3d8f8) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:22.627056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:22.628889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6a6d-5172-49c9-8b0e-7831bc9e032b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:22.636023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 358/719] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:22 2022] GET /identity/v3/role_assignments?user.id=c98929303e0e420e85db06478eb3d8f8&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:22.955692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fd68-307d-4255-a7e8-9561af44bfd2 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.956174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fd68-307d-4255-a7e8-9561af44bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.956174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fd68-307d-4255-a7e8-9561af44bfd2 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.957795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 362/720] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:22.963101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:22.963408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:22.963728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:22.987514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:22.987856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:23.067888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 359/721] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:23.514448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fd68-307d-4255-a7e8-9561af44bfd2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:23.630821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fd68-307d-4255-a7e8-9561af44bfd2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:23.677082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:23.678082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:23.678561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:23.679027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:23.695298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:23.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:23.701674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:23.702501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:23.704759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 363/722] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:23.711961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:23.758866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:23.841469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f9df2-128c-49fa-8a01-d7662700c8a1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:23.878425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:23.879042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:23.879328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:23.879641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:23.880369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:23.880680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:23.882172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:23.896221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 360/723] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:23.900885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:23.910003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:24.041162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7dd83-3c08-4723-b001-43f2d3f57887 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:24.087006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:24.087676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.087959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.088230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.099287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:24.100790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-93ce283a-6810-42ab-8203-6e9ba7d9f486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:24.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:24.124300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:24.125192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:24.125192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:24.125192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:24.125192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 364/724] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:24.131593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:24.155636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5327-22de-4437-ace6-41bd17c11b29 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.155850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5327-22de-4437-ace6-41bd17c11b29 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.156132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5327-22de-4437-ace6-41bd17c11b29 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.157865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 365/725] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:24.180072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.180356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.180635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.214606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:24.216250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:24.297674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:24.313690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da43136-46be-4425-9b83-e8fd2ad43a4e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:24.324979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:24.354471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 366/726] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 16:18:24.365389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:24.365533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.365758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.366033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.366685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:24.366988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:24.371534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:24.385359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 361/727] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:24.391573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:24.555245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d780-7358-4b5b-bb64-e903b9531f66 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:24.604229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:24.604870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.605149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.605423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.617283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:24.618749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:24.634046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:24.635038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:24.636051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 367/728] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:24.641242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:24.681789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:24.774580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:24.788866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07c8e-d5f6-44b7-af9b-9538310a4380 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:24.830006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:24.830638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.830923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.831203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.831982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:24.832296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:24.833735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4a36f-9422-4e15-9826-9adba8b8c524 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:24.857605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7190f-9c29-4793-b502-3850b9488350 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:24.858221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 362/729] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:24.859568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0fc7-83ac-4912-a658-97c4a1face10 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.859862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0fc7-83ac-4912-a658-97c4a1face10 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.860143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0fc7-83ac-4912-a658-97c4a1face10 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.861847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 363/730] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:24.862660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f0fc7-83ac-4912-a658-97c4a1face10 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:24.870772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:24.899520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:24.900489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.901069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.901543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.920145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-22a6b581-731a-4d4d-9dd4-025e51795503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:24.927286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:24.928259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:24.929077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:24.929716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 368/731] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:24.931205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:24.931570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:24.935739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:24.962248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:24.963446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:24.998561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f0fc7-83ac-4912-a658-97c4a1face10 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.037347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.037962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.038257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.038534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.048010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 369/732] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:25.049555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.096586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.129779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.131174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5bfab-5db4-447a-b551-297088e33b0f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.137125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.177168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e34f1f-b4be-48c3-9bd2-cd7c9effa1f7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.211280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.211919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.212200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.212479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.213145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:25.213449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.214831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9feb10-1e53-4da9-b210-d01991b8700c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 370/733] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6f546-2f25-4833-8ce8-e1c28fbef35c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6f546-2f25-4833-8ce8-e1c28fbef35c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6f546-2f25-4833-8ce8-e1c28fbef35c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 371/734] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353efb-cdd0-4d1a-8d24-8506b75490f4 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.227542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353efb-cdd0-4d1a-8d24-8506b75490f4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.228066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353efb-cdd0-4d1a-8d24-8506b75490f4 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.233717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 372/735] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:25.234499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe353efb-cdd0-4d1a-8d24-8506b75490f4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.248952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 364/736] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 16:18:25.250491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23188-ad00-4025-a08b-591e2feb2380 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.250777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23188-ad00-4025-a08b-591e2feb2380 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.251053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23188-ad00-4025-a08b-591e2feb2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.269235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-78a23188-ad00-4025-a08b-591e2feb2380 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:25.270535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-78a23188-ad00-4025-a08b-591e2feb2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:25.334437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.340811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 365/737] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:25.347309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe353efb-cdd0-4d1a-8d24-8506b75490f4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.347436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.347436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.347436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.363865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:25.365082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:25.384115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.384753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.385039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.385316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.392608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.396693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.398164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:25.413304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:25.414245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:25.415136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:25.415136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:25.415136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:25.415136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 373/738] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:25.416057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.441221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 366/739] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 16:18:25.442422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.538112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe95d-233a-434d-96d8-b1f506ba1635 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.552198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ecd6-a841-42af-ac5b-799769570f2e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.573351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.573981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.574297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.574921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.585528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.586997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.589826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.591194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.591699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.592427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.593265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.594864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.596030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:25.603274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:25.616713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:25.617827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:25.617827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:25.617827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:25.617827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 374/740] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:25.617827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.698781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 367/741] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:25 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:25.704989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.714344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f67462-5cd0-4aa0-8558-0b891875446a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.743205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.766365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.767823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.768681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.769139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.770139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:25.770936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.772632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.794683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 375/742] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:25.794683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.832514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152295d6-ccb3-4d89-8e3b-99637c68f1fb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.857869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.872111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.872737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.873017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.873287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.873938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:25.874242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.876594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.888839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 368/743] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:25.889755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:25.915093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a467-8c0d-4e62-85b4-d0e7e8ee0369 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:25.950888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:25.951523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:25.951816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:25.952093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:25.952831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:25.954200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:25.977708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:25.992697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ca08-fad4-43d3-bbea-d25d05f088fb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.025653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.026277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.026556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.026835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.037740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:26.039167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 376/744] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:25 2022] POST /identity/v3/services => generated 240 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:26.049366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:26.050489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 369/745] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:26.051306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.052082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.187132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4643f-f811-4758-9c4a-725242a1accd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.198319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a029da-211e-4c6c-9029-66c09793b87b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.213045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.232508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.233146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.233426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.233699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.239782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.240429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.240706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.240985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.242856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.244340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.250992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.252767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:26.257607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:26.258587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:26.259970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 370/746] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:26.263978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:26.267309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:26.268295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:26.269187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 377/747] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:26.270032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.272526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.385734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb58b2-fd38-481d-98a4-da393ef4ab2d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.403697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907add6-3f3c-4c97-8a4c-9d8c7dde79ea None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.422512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.423278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.423836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.424214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.425099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:26.425519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.427094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.446767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 378/748] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:26.447792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.452114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.453681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.453973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.454253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.454934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:26.455240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.456644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.468612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 371/749] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:26.469455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.486112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.563799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb82a8-90ea-4322-bdab-5a979760f337 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.568392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.603316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.604480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.604865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.605243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.607026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:26.607445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.609536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.615586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cd8dc-18ba-4e02-9e08-49b7d8ef90b5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.629213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 379/750] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:26.629213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.670730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.672018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.673409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.673960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.688687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.691145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:26.717481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:26.718485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:26.719407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:26.719407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:26.719407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:26.719407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 372/751] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:26.719407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.745538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.757320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135efbfd-cd64-41d3-bfe8-d2513e7899d0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.804191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.804864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.805148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.805425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.818244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.820222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:26.840040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:26.841013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:26.841994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:26.841994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:26.841994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:26.843556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 380/752] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:26.844853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.858630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d21f-ebaf-49de-ae16-1aff1fb3257e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:26.884535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:26.905910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:26.907115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:26.908011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:26.908513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:26.909537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ed5539c0c71499c95a31152732943c5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:26.910100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:26.912693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:26.927863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 373/753] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/role_assignments?user.id=7ed5539c0c71499c95a31152732943c5&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:26.928671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:26.997271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c6073-0b96-42c1-8616-feeb632204ea None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.064722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.065366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.065626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.065947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.066610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:27.066922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.068352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.095279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 381/754] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:27.099266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.110134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:27.137670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fa258-4040-4637-9ff2-9afed363602d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.204040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.204665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.204918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.205197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.205849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:27.206156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.207547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.232285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 374/755] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:27.244592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.259966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e83b7-6f07-4e2b-89eb-879b1cb79a73 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.295895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.297133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.297637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.298106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.306316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.308073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:27.322174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:27.323100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:27.324097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:27.326590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 382/756] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:27.332254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.346500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:27.401148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:27.443891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548478-2bbf-4be2-8307-4e72c1413052 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.472388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb68c6e-d14e-4f16-90ae-ce51269da5ac None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.479378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.480356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.481490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.481961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.482955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:27.483507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.485247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.511667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.512549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.513021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.513306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.515253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 383/757] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:27.520847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.521306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.522880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:27.549306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:27.550281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:27.551197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 375/758] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:27.559041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.628433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faf925-cfea-4656-9943-898809a0a0dd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.652171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:27.664303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.664977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.665261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.665540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.667457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=91692048695d4f96ad3ef501c8863b33, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.669440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc881b-0f81-4992-96c5-7ac5066825de None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.754347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 384/759] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:27 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:18:27.778980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcbbc5-c094-4fd2-9f31-e5813bfaa718 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:27.787864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:27.830909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:27.831564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.831904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.832185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.832948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:27.833263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:27.837001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:27.862672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 376/760] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:27.868655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:27.869127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ece3-fae6-4d4c-be2d-3cd6e3608ddb None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.869421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ece3-fae6-4d4c-be2d-3cd6e3608ddb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.869707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ece3-fae6-4d4c-be2d-3cd6e3608ddb None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.872554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 385/761] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:27.877106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130901-4908-4a9c-879c-036a41274ebb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:27.877398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130901-4908-4a9c-879c-036a41274ebb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:27.877680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130901-4908-4a9c-879c-036a41274ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:27.899521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-82130901-4908-4a9c-879c-036a41274ebb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:27.900788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82130901-4908-4a9c-879c-036a41274ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:27.992221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 386/762] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:28.008663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbf4-cb98-4f26-b74d-f86ff41074cd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:28.072232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:28.073258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.073736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.074340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.107628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:28.167190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:28.169620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f5402-bd6e-45bc-a24e-0531813925dd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:28.312343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 377/763] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:28.318698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130901-4908-4a9c-879c-036a41274ebb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:28.333017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c35e-2215-4981-9def-399f81ee324c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.333296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c35e-2215-4981-9def-399f81ee324c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.333494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c35e-2215-4981-9def-399f81ee324c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.339660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 378/764] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:28.341855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.342298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.342660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.378941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:28.380311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:28.461621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:28.479568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 379/765] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:28.481648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:28.506589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130901-4908-4a9c-879c-036a41274ebb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:28.531081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:28.562800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:28.563904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.565543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.580985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:28.583155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:28.606204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:28.607546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:28.608873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:28.608873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:28.608873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:28.615735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 387/766] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:28.619611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:28.733559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3abe-d775-4506-b8be-670e4c189bf5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:28.778763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:28.780272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.780734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.781379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.782712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:28.785349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:28.797964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:28.799334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:28.800404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:28.803359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 380/767] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:28.815571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:28.848932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5626c57-2ea8-407d-ab74-7a1843f3369e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:28.894156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:28.895310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:28.895976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.896262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.896541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.897193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:28.897500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:28.898892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:28.913133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 388/768] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:28.914009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:28.940933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:28.948997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcf90a-362b-4de3-8b30-686f25a33c6f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:28.987396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:28.988303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:28.988730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:28.989258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:28.990142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:28.990601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:28.992151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:28.997809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 381/769] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:28.998919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.022387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11b2c7-8412-4e9b-8b1c-f4f2fd90db4b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.059940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.060819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.061102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.061380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] PATH_INFO: `/v3/services/network` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.061967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.063358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:29.072409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:29.073530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:29.074586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:29.078665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 389/770] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:29.079590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.115021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f14e-fe1a-47c5-9a7d-ad84a8dcdd75 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.136118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.155149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.156038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.156532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.157031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.164193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.165962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.176807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:29.180963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:29.189365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 382/771] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:29.190392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.190945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afd551-a511-423a-b4a4-b22c51da1fcb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.226862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.227695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.227983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.228319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.228966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.229280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.231718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.237378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 390/772] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.238582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.294637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79ecf-cee9-4b40-9945-3ecd1ddbee90 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.331562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.332204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.332475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.332728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.333363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] RBAC: Adding query filter params (name=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.333671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.335789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.343624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 383/773] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.344805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.350794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ce63-2202-4e9c-b700-093a1f55ce51 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.390571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.391197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.391411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.391743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.392167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.393008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.393316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.394968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d9c05-c2bc-4a81-9f9b-63dd1f1c532a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.407511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 391/774] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.408725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781278de-11da-4a59-b357-82833220b593 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.420532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781278de-11da-4a59-b357-82833220b593 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.420532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781278de-11da-4a59-b357-82833220b593 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.420532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 392/775] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:29.420532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781278de-11da-4a59-b357-82833220b593 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.427623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.463903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ddf2-91f9-430b-9138-1f3828b9bb95 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.501000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.501611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.501889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.502159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.502858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] RBAC: Adding query filter params (interface=public, service_id=e4ba1150f7c24f069f5cd87a8351808e, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.503163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.504585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.518444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 384/776] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/endpoints?service_id=e4ba1150f7c24f069f5cd87a8351808e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.518444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.523680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781278de-11da-4a59-b357-82833220b593 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.561849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.562558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.562927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.563263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.564017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.564404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.565858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce653f0-62c5-4b56-a2d4-cd759c11ecc4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.570993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 393/777] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.577292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.577584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.577887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.597045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:29.598413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:29.630984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6b8a-efc5-40de-a8f0-8156da8fedb1 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.641060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.667748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 394/778] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:29.668554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.679219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.680079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.683878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.683878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.683878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=c98929303e0e420e85db06478eb3d8f8) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.684277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:29.684392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.684813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.698088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 385/779] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/role_assignments?user.id=c98929303e0e420e85db06478eb3d8f8&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.699082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.827054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6779f-9320-4a71-a7b0-3485ecb92d1c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.870065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.870694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.871006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.871466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.872136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.873536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.886476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 395/780] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.920816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea913-ec08-4a63-8907-a3054bafd48e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:29.963315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:29.963985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:29.964265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:29.964538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:29.965292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] RBAC: Adding query filter params (interface=public, service_id=30cf8ef9feb24f2fbbcc6ed78b187d82, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:29.965602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:29.967075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:29.973391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 386/781] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/endpoints?service_id=30cf8ef9feb24f2fbbcc6ed78b187d82&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:29.978690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:29.984790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:30.032067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:30.082068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:30.121955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5602f-1a22-4c7d-82fc-22c7ea765f88 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:30.161134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:30.161764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.162043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.162312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.162930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:30.164381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917d50d-e7dc-4f83-afce-90255eea349c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:30.170919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 396/782] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:30.172701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836255-9e42-4de1-be47-d9f1fd3c092b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.173085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836255-9e42-4de1-be47-d9f1fd3c092b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.173460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836255-9e42-4de1-be47-d9f1fd3c092b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.175115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 397/783] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:30.180974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586900e-472a-4f30-ba45-c385e093000b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.181264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586900e-472a-4f30-ba45-c385e093000b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.181545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586900e-472a-4f30-ba45-c385e093000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.225065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0586900e-472a-4f30-ba45-c385e093000b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:30.226297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0586900e-472a-4f30-ba45-c385e093000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:30.273775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99822a82-ac13-4f09-9dce-7273b391ff58 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:30.343844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 398/784] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:30.348292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:30.348958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.349240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.349514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.380936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:30.386150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:30.387649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:30.388637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:30.391324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 387/785] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:30.397229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586900e-472a-4f30-ba45-c385e093000b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:30.469469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:30.566291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586900e-472a-4f30-ba45-c385e093000b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:30.624195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:30.624803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.625089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.625366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.626047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:30.626354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:30.627775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:30.636679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 399/786] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:30.643086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:30.678377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:30.757645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:30.765695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b08f-d4d5-4b2d-a03a-77185a0b83f3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:30.807526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:30.807526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.807526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.808056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.826413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:30.827907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:30.861768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:30.862746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:30.863660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:30.863660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:30.863660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:30.863660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 388/787] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:30.872433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:30.887853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab607-7062-4a8f-8ca8-41ffd38d9513 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:30.918005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:30.932771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:30.933424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:30.934234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:30.934674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:30.960969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:30.967474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:30.969602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:30.971596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:30.979160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 400/788] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:30.985250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.081080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed3d-23dc-4d8b-8921-edfa5fd0f864 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.118385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.119009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.119295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.119656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.120317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:31.120621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.122580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.136456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 389/789] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:31.148371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.166555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75ebd-1a62-40c2-9e18-f2cd9a251cb7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.170323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:31.234432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.235662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.236988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.240060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.240974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:31.241484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.243064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.257523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 401/790] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:31.265117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.317938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb46c69-ea18-44b0-9f4c-beb4030367e8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.351251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.352000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.352207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.358321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.360057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:31.368697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.370438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:31.382612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:31.383746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:31.384929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:31.386952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 390/791] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:31.392330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.451576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc93a-3180-4783-b47b-908092c342fd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.475857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:31.500650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f92b-1f20-4784-b375-67426c26e4c7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.524808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.525460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.525739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.538886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.539695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.540092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.540472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.541344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:31.541767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.543933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.545887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.547373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.564689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 391/792] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:31.570151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:31.577133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:31.578087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:31.578977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:31.578977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:31.578977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:31.583896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 402/793] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:31.584743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.709566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:31.715812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959aa2-f520-4ccb-9968-62385f8e1028 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.777822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.778753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.779038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.779319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.780003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:31.780320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.782405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.797332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601d6d1-c03b-44db-8359-cac08c2edf63 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:31.811981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 403/794] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:31.815493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.848063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:31.857385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:31.862325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:31.862325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:31.862325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:31.870345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:31.875029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:31.907338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:31.908353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:31.909260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:31.909260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:31.909260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:31.915151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 392/795] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:31.916325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:31.969944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6f37e-f9dd-4b0d-a1cc-af18dbafbbd3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.007080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.007806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.008091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.008372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.016902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.018389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:32.030347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:32.031329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:32.032309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 404/796] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:32.037653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.065425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.123169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30d9e-a450-4752-9f0d-31b934823bf8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.162665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab7129-1373-4a30-abd6-56c3708570b4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.164223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.164848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.165141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.165421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.166145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:32.166460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.168451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71e02-75fd-4193-bc48-79cf14ee5186 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.182000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 393/797] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:32.182000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6806-8bbf-4c3d-ac2f-84889e87cc34 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.182000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6806-8bbf-4c3d-ac2f-84889e87cc34 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.184506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6806-8bbf-4c3d-ac2f-84889e87cc34 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.189894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 394/798] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:32.189894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebb4e-7ae8-41f4-bd43-38e5d1d8ba04 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.189894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebb4e-7ae8-41f4-bd43-38e5d1d8ba04 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.189894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ebb4e-7ae8-41f4-bd43-38e5d1d8ba04 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.189894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 395/799] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:32.190257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ebb4e-7ae8-41f4-bd43-38e5d1d8ba04 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.206525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.207143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.207426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.207731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.208473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:32.208783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.210213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9a6bd-b3c4-4df2-a684-eb6eb2fcb90e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.228948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 405/800] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:32.231727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b7a7-99f5-44ed-8ea2-298ecf7fec89 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.232038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b7a7-99f5-44ed-8ea2-298ecf7fec89 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.232318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b7a7-99f5-44ed-8ea2-298ecf7fec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.236395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.251443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-16f1b7a7-99f5-44ed-8ea2-298ecf7fec89 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:32.252691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-16f1b7a7-99f5-44ed-8ea2-298ecf7fec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:32.305132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ebb4e-7ae8-41f4-bd43-38e5d1d8ba04 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.323464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 406/801] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:32.324865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.325153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.325430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.343868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:32.345048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:32.347233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.354335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.355960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.356428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.356879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.366187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.368774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:32.384590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:32.385706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:32.386905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:32.389188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 396/802] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:32.390102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.438784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 407/803] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:32.439930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.503335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.510856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3283-4e37-4b55-a0d0-b890311bc3bf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.550056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.551087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.551528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.551940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.617914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bec0b5-168c-4049-9ed6-fd971e2259dc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.630367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.631869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.654114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.654719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.655007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.655267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.656008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:32.656312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.657743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb151a9-b29a-4cf7-bd4e-61b38655fce7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.665009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 408/804] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc524d-08eb-4b3e-aeac-cf80bf999a0c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc524d-08eb-4b3e-aeac-cf80bf999a0c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc524d-08eb-4b3e-aeac-cf80bf999a0c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 409/805] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:32.674985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc524d-08eb-4b3e-aeac-cf80bf999a0c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.735958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.743337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 397/806] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:32.744085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.786194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc524d-08eb-4b3e-aeac-cf80bf999a0c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.820877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.821497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.821774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.822054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.822627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.824074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4fbe977b-e2ff-429c-9e44-c0ac48a962a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:32.832769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:32.833912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:32.834759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 410/807] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:32.835556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.835556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.835556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.847970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff041-0182-4859-92ef-6878610f39fe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:32.852311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:32.853492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:32.881979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:32.882632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:32.882917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:32.883191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ed5539c0c71499c95a31152732943c5/roles/45a6ed02312a474785f158860216c19f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:32.897582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=7ed5539c0c71499c95a31152732943c5, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:32.899001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:32.911141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:32.920900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 411/808] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:32.921778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:32.991520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 398/809] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:32 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ed5539c0c71499c95a31152732943c5/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:32.991520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.046968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ef6f-de27-4e13-9fcb-32a43ea73271 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.058127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.091130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.092171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.092690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.093123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.106849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.108803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.127846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960206a2-bfe3-4b0c-af1a-f23d6cd0f3df None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:33.128185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:33.129284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:33.130380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:33.130380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:33.130380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:33.132212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 412/810] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:33.133217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.172264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.172905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.173181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.173453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.185230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:33.190199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:33.191198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:33.192375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 399/811] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:33.193048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.205832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.257578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457750-8c7d-4cfd-8326-233561756c96 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.294637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.295249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.295538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.295821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.296452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:33.296760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.298203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.307051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 413/812] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:33.307051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.307286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c078ea-1a66-4214-bce6-e2de28fa04c0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.316203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.344158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614157-f710-4573-b40e-00500938725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.344776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614157-f710-4573-b40e-00500938725d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.345057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614157-f710-4573-b40e-00500938725d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.345333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614157-f710-4573-b40e-00500938725d None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.345983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614157-f710-4573-b40e-00500938725d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:33.346286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614157-f710-4573-b40e-00500938725d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.347696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614157-f710-4573-b40e-00500938725d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.362653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 400/813] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:33.364725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614157-f710-4573-b40e-00500938725d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.419921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9734da-5e7e-4c53-8282-3b3e577dd48b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.430190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.458746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.459376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.459687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.459969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.460640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:33.460950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.462338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.475804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 414/814] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:33.475971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614157-f710-4573-b40e-00500938725d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.476092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.519319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.520075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.520425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.520765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] PATH_INFO: `/v3/services/network` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.521413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.522846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:33.534721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:33.536108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:33.536950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 401/815] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:33.537709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.572380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.586950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39ed2-2297-4499-bdeb-f79352f9b8e4 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.623344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.624007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.624246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.624519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.625150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:33.625452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.626934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.635386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 415/816] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:33.635386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.661131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab4ffe-87c8-4682-a13f-2e6795e9f1ef None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.672205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.700537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.701402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.701533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.701716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.708372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.709821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:33.721756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:33.722635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 402/817] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:33.724397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.746376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cfe1-2453-43a3-9b29-f6a6003dd60d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.785850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.786749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.787033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.787579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.801989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.803973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.818708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:33.837558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:33.838614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:33.839523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:33.839523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:33.839523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:33.840218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10f0-3302-474c-b919-6c3b9a34993f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.840295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 416/818] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:33.840295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.867527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.868237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.868589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.869000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.869575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] RBAC: Adding query filter params (name=network) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:33.869888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.871307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.881099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 403/819] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:33.881099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:33.930579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:33.946895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b173bc5-9fb3-4043-aec0-46ca7bfee347 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:33.982256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:33.982871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:33.983152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:33.983424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:33.984140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:33.985507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:33.989900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2609f4-b549-44d4-9af4-03761dd46c0b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.025374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.026030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.026291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.026567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.027295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:34.027648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.029222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.040994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 404/820] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:34.043430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.059024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:34.102977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 417/821] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:34.103918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.172136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dabbf-6c42-4e6d-a10e-6bde1ec048e7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.223673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.224451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.224968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.225343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.226111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:34.226519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.228150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.248030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 405/822] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:34.248030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.270976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121fd3e-3533-4de9-8820-0ac0e2504ce9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.320308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.320520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.320667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.320945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.322186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] RBAC: Adding query filter params (type=network) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:34.322186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.323331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.329611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 418/823] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:34.330431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.338527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:34.339696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:34.376298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680666-51ad-47b6-80e6-48247148b267 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.422148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.423235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.423760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.424198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.425015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:34.425539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.427455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.436457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 406/824] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:34.438720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.460978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bf7dd-d12a-4296-9cb3-8ed581750e1e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.533981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.534978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.535439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.535882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.551344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.553211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:34.572412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:34.573638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:34.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:34.585442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 419/825] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:34.592949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.651901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199345c1-cd2b-4377-a386-c07febb7db93 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.698845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.700325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.700654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.701567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.701567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.702913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444bff2-f6ca-4148-b2af-4c00b9a5d636 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.710833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:34.717101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:34.747328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1b637-5052-40e8-b7f6-b22229e2c451 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.783959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:34.784900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.785333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.785756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.786633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:34.787126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:34.788758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:34.810686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 420/826] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:34.816482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:34.819148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 407/827] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:34.948373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8142-8c02-4874-8756-0799426765bb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.948576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8142-8c02-4874-8756-0799426765bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.948832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8142-8c02-4874-8756-0799426765bb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.954412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 408/828] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:34.956000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:34.956288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:34.956564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:34.956738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dee4-497a-4180-abd1-7e102b1b09f6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:34.987863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:35.007720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.008938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.008938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.009235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.010861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:35.012643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:35.022366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.023299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:35.038288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:35.039446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:35.040603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:35.040603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:35.040603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:35.041930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 421/829] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:35.057183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.105730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 409/830] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:35.181437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b81fb-92cb-456a-97ce-490fa2d2dd28 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.223114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.223748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.224049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.224310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.224969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:35.225279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.226676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.239858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 422/831] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:35.245433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.358899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e4ad3-0e15-46af-9fbe-b3242a007af4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.380584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:35.396031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.396672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.396955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.397329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.398419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.406273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.407937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:35.419882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:35.420931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:35.422087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 410/832] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:35.430913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.443191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:35.531330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6554499-b4de-4d24-a0e5-1179d1c24161 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.556434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b141d90-021b-4038-88d7-6b5563ef8d78 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.569155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.569875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.570368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.570723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.585791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:35.592017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:35.593188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:18:35.595205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:35.596695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.596695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.596695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.596695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.597238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:35.597238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.597238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.603752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 423/833] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:35.603752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.615626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 411/834] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:35.617102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.673948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:35.710008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:35.719974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48440-1b6b-408f-97ac-2e592c1f1918 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.747825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ba51-f66b-467b-b9cf-b898a7f824c6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.767909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.768534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.768816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.769094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.769769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:35.770074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.772334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.784081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 424/835] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:35.786844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.787794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.788636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.789112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/c98929303e0e420e85db06478eb3d8f8/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.789447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:35.791516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=c98929303e0e420e85db06478eb3d8f8, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.793307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.863233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 412/836] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:35 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/c98929303e0e420e85db06478eb3d8f8/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:35.912463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e571-6877-4fe1-a1ed-f985f6d1b1b8 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:35.955405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:35.956092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:35.956376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:35.956651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:35.969194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:35.970692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:35.986851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:35.987873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:35.989328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:35.989328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:35.989328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:35.989328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 425/837] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:35.993875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.104963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.108908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa842f0-9ada-4edf-99b4-b9e676124f3f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.146278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.146905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.147186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.147462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.148158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:36.148465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.149846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50a1e7-8e85-47d8-a787-7f150be695c0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.163110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 413/838] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:36.169727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.182735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.200617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3310f-05af-4437-8996-98548d1c6aa9 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.201249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3310f-05af-4437-8996-98548d1c6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.201723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3310f-05af-4437-8996-98548d1c6aa9 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.207155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 414/839] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:36.209353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.209920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.210386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.229045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:36.231229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:36.284387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e131-c75f-4e46-93bd-3c8eabb46075 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.312979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 415/840] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:36.334827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.335887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.336372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.336863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.345277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.346990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:36.365033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:36.365979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:36.366968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 426/841] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:36.372545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.467119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.476512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe998-7599-4171-9ee9-54e0313ab23d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.511753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.512379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.512672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.513279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.514017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:36.514640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.516462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.534292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 416/842] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:36.540591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.607903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.617786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.656825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48073-0a85-49b0-8c77-0c3530c9a37f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.704196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.704925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.705524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.705817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.750254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee95-9f80-4e5b-98da-9ddfb9145c16 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.791584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.792586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.793639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.794311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.794794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.795209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757c3ca-ce93-49df-9edd-a92c1258fe61 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.795859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.797515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-19c82ceb-5865-459a-9ab7-761055eaff3e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:36.807226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:36.808292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:36.809461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:36.812698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 417/843] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:36.815796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b302cb-fc4a-4473-94d6-90e9ca5fa493 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.816313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b302cb-fc4a-4473-94d6-90e9ca5fa493 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.816781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b302cb-fc4a-4473-94d6-90e9ca5fa493 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.818876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 418/844] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:36.819843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b302cb-fc4a-4473-94d6-90e9ca5fa493 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:36.837197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.867116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:36.910289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 427/845] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:36.911556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.911854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.912128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.932603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:36.932991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b302cb-fc4a-4473-94d6-90e9ca5fa493 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:36.934378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:36.968526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:36.969128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:36.969407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:36.969677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:36.970302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:36.970601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:36.972931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:36.983510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 419/846] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:36.983510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.011732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 428/847] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:37.011732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.094945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.126220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96abd-b09f-45d7-88b2-f63d59539ee7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.142675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.148887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435975f6-ebd1-4167-ab0e-af9aecd4d0b4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.167256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.168178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.168635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.169057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.180262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.181907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.187758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.188363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.188642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.189007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.190032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.190151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.191509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.196742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:37.198412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:37.200872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:37.202193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:37.202193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:37.202193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:37.207546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 420/849] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:37.208885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.303919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.327543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea72917-95cf-4d93-ad29-9d30c862b599 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.378449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.379066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.379349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.379718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.380370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.380682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.382061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.400648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 430/850] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:37.406740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.429485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.443738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c876-c851-41bc-89db-8baf30dca800 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.474089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.483475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.484428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.484899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.485431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.486190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.487873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:37.499280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:37.500273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:37.501149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:37.508714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 421/851] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:37.510299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.513863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab28ffc-c362-479c-94d7-e53ea107eae9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.549883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.550618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.551015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.551311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.559025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.561053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:37.572633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:37.573572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:37.575341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:37.579553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 431/852] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:37.580490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.631439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d194-77c4-457b-a15c-e19cb729f268 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.665891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.671201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.672083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.672771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.673219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.677816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.677816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.677816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.686763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 422/853] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:37.688285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.689721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef632-68f8-4f42-9403-5de36b606b5a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.726282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.727000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.727356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.727730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.728524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.728909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.730865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.748485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 432/854] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:37.749642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:37.755024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:37.806181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb5ea-81a9-4e2b-8a61-19b0b8d3a7b4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.845099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.846008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.846461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.847029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.847959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.848437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.850068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c634f32-751a-438c-bff5-01c4c21495e6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.853819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e1d1-a630-49e7-9232-1a0540adb900 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:37.856562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 423/855] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:37.858116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98c0b-89c7-4ecb-ad1f-341e37c9de62 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.858580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98c0b-89c7-4ecb-ad1f-341e37c9de62 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.859293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98c0b-89c7-4ecb-ad1f-341e37c9de62 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.862209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 424/856] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:37.867305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.867901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.868388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.890406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:37.892156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:37.895275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:37.895969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:37.896252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:37.896528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:37.897762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ed5539c0c71499c95a31152732943c5) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:37.897762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:37.899052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:37.911869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 433/857] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:37 2022] GET /identity/v3/role_assignments?user.id=7ed5539c0c71499c95a31152732943c5&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:37.981418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 425/858] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:38.255657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:38.259520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:38.368823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da839e2-4322-4329-be2f-3c330b29a5b1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:38.404238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:38.404882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:38.405170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:38.405449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:38.416124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:38.422316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:38.423416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:38.424630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 434/859] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:38.429419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:38.486582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:38.541911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f1dd-80a3-45aa-9eda-05880887a239 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:38.578123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:38.578803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:38.579090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:38.579367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:38.580073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:38.580384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:38.581769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:38.590765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 426/860] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:38.596597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:38.661340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:38.702390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f30d-91f8-4a2b-881f-c686fd45d497 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:38.737398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:38.738031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:38.738313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:38.738590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:38.750154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:38.751644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:38.766156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:38.767065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:38.768356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:38.768356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:38.768356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:38.768356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 435/861] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:38.775313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:38.882331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99752-50e9-4572-bd28-88608508d49b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:38.895720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:38.917099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:38.918290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:38.918568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:38.918844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:38.919509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:38.919822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:38.921193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:38.934496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 427/862] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:38.940393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.052609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf9c09-36c4-46ed-a99f-6efa5eb2536b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:39.072989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:39.091459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:39.092122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.092405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.101054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.101054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:39.102512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-b09e24e4-a383-406a-b7c1-837e9d083e4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:39.115246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:39.116295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:39.117214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 436/863] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:39.124521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.227220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe35d-24ce-4f34-bc9c-62dc18e22e36 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:39.266605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:39.267219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.267514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.271503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.271503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:39.271503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:39.271503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:39.274228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ffc40-680e-4ab0-964c-d5ae4acc3bee None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.274521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ffc40-680e-4ab0-964c-d5ae4acc3bee None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.274803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ffc40-680e-4ab0-964c-d5ae4acc3bee None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.276416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 437/864] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:39.281767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.282059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.282342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.288484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 428/865] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Aug 19 16:18:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:39.296472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.300946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:39.302171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:39.329589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:39.386196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 438/866] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:39.428430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8bdfb-db15-4891-a88c-a1a2760ff4f3 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:39.466345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:39.466968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.467253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.467552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.543085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:39.544855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:39.583548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:39.658657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 429/867] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:39.662506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.664513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.788920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548626d-85df-4a49-be18-6b0fb784b551 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:39.789767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2d65-c7bd-457f-9f6d-752d2ec31201 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:39.799226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:39.830675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:39.834750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:39.835508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.835890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.836260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.837067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:39.837919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:39.838782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.838896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af27d3d-38fa-4f17-b774-7f60fca8345b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:39.839316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.840586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.852772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:39.854292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:39.870588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:39.871797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:39.872681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:39.872681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:39.872681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:39.875560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 430/868] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:39.877968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:39.939946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 439/869] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:39 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:39.959703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7f0c-e2c6-4749-b6f8-4c0d163461c0 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.959703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7f0c-e2c6-4749-b6f8-4c0d163461c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.959703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7f0c-e2c6-4749-b6f8-4c0d163461c0 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.959703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 440/870] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:39.967832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4df6-b8ac-41f3-8f32-a53f93e6a710 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.968370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4df6-b8ac-41f3-8f32-a53f93e6a710 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.968825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4df6-b8ac-41f3-8f32-a53f93e6a710 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.971536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 441/871] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:39.973609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:39.974417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:39.974950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:39.997169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:39.998434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:40.000330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4bd8-8d95-438b-999d-28f32d8f1591 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.044833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.045923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.046432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.046902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.047791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:40.048348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.050040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51701-50cd-40a6-afac-9536cf3a7407 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.064542 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 431/872] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:40.066090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.066530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.066949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.087508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 442/873] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:40.087508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.091921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:40.093161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:40.130783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.184061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 432/874] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:40.197562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.204016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abc7da-c12d-4125-af69-04f795001ed1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.240138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.240769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.241047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.241318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.249678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.251185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:40.262571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:40.263464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:40.264400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 443/875] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:40.269541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.356760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.400704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0c87-acd9-4af9-b0cc-7c20c4106f8c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.438322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.438940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.439220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.439507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.440339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:40.440651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.442136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.455710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 433/876] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:40.461163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.487381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ae9d4-9fde-47de-8ac8-710ad74f5c08 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.495003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.526536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.527853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.528325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.528610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.540424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:40.546012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:40.551635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 444/877] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:40.552578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.569425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.578911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf0ac6-9989-46d6-b794-fef48ee8b7ca None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.613992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.614607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.614943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.615374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.616054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=c98929303e0e420e85db06478eb3d8f8) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:40.616362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.617785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.635698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 434/878] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/role_assignments?user.id=c98929303e0e420e85db06478eb3d8f8&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:40.637183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.673010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a86-900d-468c-b9d3-47a7ba83f4af None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.713853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.715005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.715361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.715693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.716589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.718202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.767295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.776459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0ed4-fdf7-433a-b16d-e09009651418 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:40.813978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:40.816060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:40.816350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:40.816968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:40.817705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:40.818150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:40.819967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:40.825967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 445/879] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:40 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:40.831048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 435/880] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:40.837367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:40.930499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:40.966311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41554caa-be9f-4ff0-8b3b-f5f68a0b2738 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:41.002353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:41.002997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.003280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.003594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.015612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:41.017763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:41.034077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:41.035066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:41.035987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:41.035987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:41.035987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:41.035987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 446/881] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:41.042375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:41.153099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0552f-923b-48c1-a4d5-3670662f7d61 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:41.191107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:41.192112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.192599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.193070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.193918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:41.194439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:41.196042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:41.208710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 436/882] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:41.215003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:41.321175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee1a3c-dab5-48e3-87e6-b7f6676557ab None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:41.345895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:41.364522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:41.365466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.365911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.366348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.376133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:41.378448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:41.391664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:41.392637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:41.393544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:41.396164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 447/883] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:41.407504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:41.418735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:41.507815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672d70-69c2-49ae-b035-91188ef22b3a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:41.542633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:41.543287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.543714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.543994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.544733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:41.545042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:41.546470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:41.565642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 437/884] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:41.571196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:41.677980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fede-cbad-457e-8cf3-2696cbb59ed2 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:41.713189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:41.713809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.714116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.714417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.772188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:41.784563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:41.786031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391d62a-1433-4789-b30b-4bb5644801ba None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:41.891236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 448/885] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:41 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:41.896570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:41.941663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809063-8e28-454b-aa2c-e5cfee7a77f1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.941976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809063-8e28-454b-aa2c-e5cfee7a77f1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.942231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809063-8e28-454b-aa2c-e5cfee7a77f1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.945337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 449/886] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:41.950486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:41.950775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:41.951053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:41.970708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:41.971964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:41.977692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.019703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d106-702f-42c9-9621-21d821eb3e3b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.060120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 450/887] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:42.071101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.071101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.071101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.071101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.080713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.082236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:42.097527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:42.098452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:42.099329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:42.099329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:42.099329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:42.099329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 438/888] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:42.104584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.121215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.210214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd9f1-f4ae-4927-ac70-aba051b5aba5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.244931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.246404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.246941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.247418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.248369 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:42.248896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.250530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.263344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 451/889] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:42.269302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.326846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.383547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81e3f-151d-4c49-ac7d-0b52c2c51820 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.412649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.423225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.431637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.431637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.431637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.431637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.435039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.437009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:42.449679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:42.450593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:42.451455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:42.451899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8736d-5172-418c-8f81-1effb4eca3ce None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.453624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 439/890] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:42.461084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.491914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.492634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.492921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.493207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.493784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.495174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:42.505122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:42.506353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:42.507362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 452/891] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:42.514771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.582651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd722-e069-4283-9141-e54d1dcbaa18 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.618206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c42add-d813-4278-84e4-4f9b04b7ea54 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.621928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.622531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.623001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.623462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.624401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:42.624914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.626705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.645661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 440/892] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:42.646976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.654277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.654894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.655171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.655443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.656111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:42.656412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.657782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.663522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 453/893] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:42.669299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.672480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.714967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.786885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab98c-677c-4548-ae88-f34338b9578e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.792666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70896e1-fe89-4789-97a0-32e73deac47d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.822651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.823611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.824799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.825181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.825974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] RBAC: Adding query filter params (role.id=91eb631c8571477cb225ffb15150295a, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ed5539c0c71499c95a31152732943c5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:42.826383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.827850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af2921-6700-4b7d-8a37-6e4adc3a7706 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.829641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.830282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.830533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.830809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.831441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:42.831777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.833205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.835157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 441/894] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/role_assignments?user.id=7ed5539c0c71499c95a31152732943c5&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=91eb631c8571477cb225ffb15150295a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:42.836540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf81d-8c07-4dfa-b6d7-ce6100d8ae47 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.837001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf81d-8c07-4dfa-b6d7-ce6100d8ae47 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.837451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf81d-8c07-4dfa-b6d7-ce6100d8ae47 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.839294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 442/895] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:42.844944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0078dd-cde5-4d5f-b6c3-7ca92662b731 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.845538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0078dd-cde5-4d5f-b6c3-7ca92662b731 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.845985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0078dd-cde5-4d5f-b6c3-7ca92662b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.847559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 454/896] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:42.853189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.872325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae0078dd-cde5-4d5f-b6c3-7ca92662b731 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:42.873542 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae0078dd-cde5-4d5f-b6c3-7ca92662b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:42.943392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:42.953863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 443/897] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:42.955293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbdf0-2df3-4113-82d1-a20d22c6f18b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.955614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbdf0-2df3-4113-82d1-a20d22c6f18b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.955895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbdf0-2df3-4113-82d1-a20d22c6f18b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.957361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 444/898] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:42.965983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.966312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.966540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.986596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:42.987837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:42.989043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10512d-1892-4781-ba4b-d29dde5ea419 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.022730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:43.040258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.041002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.041394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.041772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.042624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] RBAC: Adding query filter params (interface=public, service_id=5ae9a0bd7aa94f42b49dbf1bd8bc18e2, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:43.043111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.044729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.052718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 455/899] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/endpoints?service_id=5ae9a0bd7aa94f42b49dbf1bd8bc18e2&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:43.057785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.083968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 445/900] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:43.170874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824423e-9060-42e7-a0ef-1822bc87f92a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.200292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:43.206746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.207356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.207666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.207941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.217002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.217002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.217002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 456/901] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:18:43.241874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.362054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2b3b0-2fe5-457a-b8df-bc61104c94e8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.399253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.406664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.407312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.411505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.411505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.411505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.411505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:43.420094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:43.421111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:43.421946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 446/902] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:43.427406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.462481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:43.534779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04756d98-8731-438d-9428-76a60c3a822d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.539650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f871f-c791-456d-a20e-5f0e3573758e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.572686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.573321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.573603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.573990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.574975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.575515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.576137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.576416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.576531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.576685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.577320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:43.577624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.579168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.584230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 447/903] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:43.585893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:43.586774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:43.587679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 457/904] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:43.594058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.596250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.684328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:43.715772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:43.723911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441395-6db8-47de-8735-06dc9c7e9a13 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.724596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9c5f-81de-45d5-8fdd-6c3c9319646b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.766400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.767329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.767820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.768339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.768998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.769373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:43.769800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.770009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.770256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.770625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.771446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:43.771877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.772264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.773428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.778962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 448/905] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:43.785758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 458/906] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:43.796716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:43.915759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a16dd-c318-4672-9181-d44991cee0f7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:43.955797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:43.956386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:43.956610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:43.956860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:43.957494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:43.957801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:43.959163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:43.965253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 449/907] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:43.971154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:44.079609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eaafc-09b0-4a40-92d7-2cae27075b7f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:44.103348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:44.115558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:44.116196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:44.116480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:44.116759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:44.117463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] RBAC: Adding query filter params (interface=public, service_id=b6b8b9c2a3d340a78f0613ec86d37409, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:44.117775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:44.119160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3fbf6-fa48-4cd5-a823-c20c46111fe6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:44.124954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 459/908] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:43 2022] GET /identity/v3/endpoints?service_id=b6b8b9c2a3d340a78f0613ec86d37409&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:44.130348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:44.160505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:44.246518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc487c-f26f-4590-8ceb-99429a22f914 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:44.285190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:44.285816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:44.286097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:44.286441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:44.287060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:44.288471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b82a2-26e0-4cb0-b387-309ab2fae469 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:44.295513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 450/909] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:44 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:18:44.774724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9cd1-ee93-4133-977f-e20f6e2e3f6d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:44.775108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9cd1-ee93-4133-977f-e20f6e2e3f6d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:44.775286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9cd1-ee93-4133-977f-e20f6e2e3f6d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:44.776902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 460/910] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:44.782312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7a32-99db-4660-bd75-546c927d05ec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:44.782597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7a32-99db-4660-bd75-546c927d05ec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:44.782869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7a32-99db-4660-bd75-546c927d05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:44.801695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ccea7a32-99db-4660-bd75-546c927d05ec None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:44.802889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ccea7a32-99db-4660-bd75-546c927d05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:44.873198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 451/911] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:45.139339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf9cd1-ee93-4133-977f-e20f6e2e3f6d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.248120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf9cd1-ee93-4133-977f-e20f6e2e3f6d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:45.276184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e6c2-d43f-45c7-8524-65adf9a9c053 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.277716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e6c2-d43f-45c7-8524-65adf9a9c053 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.278501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e6c2-d43f-45c7-8524-65adf9a9c053 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.283854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 452/912] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:45.284056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:45.284654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.284942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.285224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.286383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.286871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.287346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.298529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:45.304243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:45.305156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:45.306661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 461/913] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:45.311356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:45.311663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.313077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:45.328996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:45.376986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:45.401421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 453/914] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:45.441667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9dabf-b739-40ea-bacf-c1694cb6850a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:45.479526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:45.481024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.481521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.481988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.482844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:45.483359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:45.484940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:45.498542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 462/915] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:45.504088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.608468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1c75-e7b5-4edd-9f6a-8f56ac1646c7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:45.643876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:45.644866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.645366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.645834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.659474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:45.659474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:45.667278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:45.674389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:45.675302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:45.676190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:45.676190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:45.676190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:45.678202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 454/916] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:45.684557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.697844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.790444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50002a5-17c7-41e3-8251-58a2b229ebdb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:45.800850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:45.807627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13ab1-bb5d-477b-a8fd-a64fb594381f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:45.829079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:45.830000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.830471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.830920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.831973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:45.832456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:45.834009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e1de2-f378-42da-b0ad-b8f921fd1003 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:45.844423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:45.845056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.845342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.845619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.846208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:45.847595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:45.849150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 463/917] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:45.850641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d516-e00f-42e6-8558-139708e99286 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.850928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d516-e00f-42e6-8558-139708e99286 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.851204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d516-e00f-42e6-8558-139708e99286 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.852707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 464/918] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:45.858800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:45.859086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:45.859362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:45.861042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:45.861985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:45.862801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 455/919] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:45.863629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.886575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:45.888084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:45.929320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:45.960533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 465/920] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:45.961478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:45.976214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc09bf-21c6-498c-9317-d87066df41c9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.021015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.022065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.022546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.023027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.031904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.033745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:46.045559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:46.046577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:46.047529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:46.050004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 456/921] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:46.055853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.079783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.084404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae9831-d5fa-485b-8bc3-e69baa146a96 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.130139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.130752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.131033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.131310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.132139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:46.132446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.134553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.143550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 466/922] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:46.146823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.185436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879015-987d-4a81-be5b-84b271e2a594 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.212192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.225355 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.228025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.228025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.228025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.228320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:46.228648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.230635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.249875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 457/923] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:46.250759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.263769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e616c-39b4-4644-b1e8-167dfebdb06a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.296841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.297446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.297732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.298009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.298647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:46.298950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.300363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826e2c3-fe28-40f0-ac47-7c70b89f75da None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.305409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 467/924] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:46.306543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9d81f-9a9a-4195-8c79-cc5ffa13c264 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.306831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9d81f-9a9a-4195-8c79-cc5ffa13c264 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.307109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9d81f-9a9a-4195-8c79-cc5ffa13c264 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.309201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 468/925] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:46.312279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9d81f-9a9a-4195-8c79-cc5ffa13c264 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.339432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.356900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccc74-d00f-4c6d-9fe8-9257e45c600f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.393062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.393670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.393947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.394219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.394860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.396246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.421159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9d81f-9a9a-4195-8c79-cc5ffa13c264 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.455229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.455827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.456116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.456392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.462090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 458/926] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:46 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:46.462882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.467977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.469670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-1ae104d0-2022-405b-b78f-823ff76c229d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:46.487084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:46.488166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:46.489074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:46.489074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:46.489074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:46.489074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 469/927] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:46.490058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.490424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.490775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.509781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:46.511031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:46.529203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.601799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 470/928] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:46.602733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.603138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855458a-64b7-4906-a052-c701d64299b0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.614464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.649495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.650115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.650395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.650666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.651331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.652814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.714083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 459/929] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:46.740198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfa6e-6db9-4f66-a18a-7301596a8890 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.788910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.789537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.789820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.790097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.790760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:46.791065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.793203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.806964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 471/930] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:46.813051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.910887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:46.924413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.932027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c7249-5f3d-4b31-ab2e-35222fb0e5e9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:46.969856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:46.970445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:46.970730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:46.971006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:46.978088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:46.979625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:46.983855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:46.992351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:46.993390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:46.994270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 460/931] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:46.999458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.021083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6408-ddbc-4ae8-99a5-0a075046b185 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.057304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.058393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.058928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.059539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.060587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.062167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:47.071472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:47.072516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 16:18:47.073427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:47.076999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 472/932] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:47.086796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.111736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0c52-3729-4b4b-8cf7-077e6afdd9a9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.150239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.150849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.151131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.151411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.152332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:47.152885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.154320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.173107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 461/933] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:47.174012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.191624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:47.222519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75174d-c19b-425b-be65-c72c8c8d6b2e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.264001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:47.275174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.276206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.276588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.277794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.279043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:47.279732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.281359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.284281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b296dfc-9ece-4ae1-babd-239c1c12fc55 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.287987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 473/934] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:47.294105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.323278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.324343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.324825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.325300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ed5539c0c71499c95a31152732943c5/roles/91eb631c8571477cb225ffb15150295a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.327777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=7ed5539c0c71499c95a31152732943c5, role_id=91eb631c8571477cb225ffb15150295a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.329410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812685-bb70-4e00-ba22-29e7ed1ef1b4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.413355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d7a5-07c2-4eed-883f-55c09a634344 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.450863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.451774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.452197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.452613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.453383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:47.453829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.455449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.460958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 474/935] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:47.468579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.479559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 462/936] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:18:47 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/7ed5539c0c71499c95a31152732943c5/roles/91eb631c8571477cb225ffb15150295a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:47.532490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:47.589095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491d62-217b-4896-b46b-34e9e1f76a55 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.626910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.627646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.627929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.628207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.628893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.630338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666d879-7dd5-49d7-a072-8b4689d7f3a3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.715127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 475/937] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:18:48.483998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a8d9-c341-47cd-bd8b-f64f8d0402e3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.484998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a8d9-c341-47cd-bd8b-f64f8d0402e3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.485504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a8d9-c341-47cd-bd8b-f64f8d0402e3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.487306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 463/938] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:48.492328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d03e5-1167-4ebf-ab50-d868cc46d581 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.492739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d03e5-1167-4ebf-ab50-d868cc46d581 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.492907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d03e5-1167-4ebf-ab50-d868cc46d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.512058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e08d03e5-1167-4ebf-ab50-d868cc46d581 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:48.513262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e08d03e5-1167-4ebf-ab50-d868cc46d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:48.587892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 476/939] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:48.761874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a2d8-d1c2-4394-ba58-d905722e67bb None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.762051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a2d8-d1c2-4394-ba58-d905722e67bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.762313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a2d8-d1c2-4394-ba58-d905722e67bb None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.763950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 464/940] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:48.769229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.769624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.770001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.788632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:48.789974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:48.818126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:48.861505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 477/941] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:48.870194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a2d8-d1c2-4394-ba58-d905722e67bb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:48.953971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:48.981379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a2d8-d1c2-4394-ba58-d905722e67bb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.019240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.020233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.020717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.021205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.022038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.023680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:49.033775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:49.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:49.035666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.038359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 465/942] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:49.044199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.132761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.149897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cec21-5f2f-4edc-b72a-ef83d9ceaf23 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.185566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.186180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.186540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.186728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.187348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:49.187680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.189078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.194366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 478/943] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:49.201568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.239952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:49.254805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864200-dae8-4f06-8fbe-7f9d2c27c63c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.302085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.303019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.303404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.303812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.304761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.306581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.310735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING keystone.server.flask.common [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 16:18:49.321745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:49.322251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740760a1-5fd1-47e9-bf92-00db4e1a1e97 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.364046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.364735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.365090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.365454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.366175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:49.366543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.368124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.379576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 479/944] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:49.380697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.sql.core [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 16:18:49.380697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 16:18:49.380697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [parameters: {'id': 'a93b50ba33514e3fb9ca8a6a2d12b644', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 16:18:49.380697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 16:18:49.381743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a93b50ba33514e3fb9ca8a6a2d12b644.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a93b50ba33514e3fb9ca8a6a2d12b644. Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:18:49.391429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 16:18:49.392312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application yield resource Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise self.value Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application session.commit() Aug 19 16:18:49.393255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.session.flush() Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application compat.raise_( Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 16:18:49.394162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 16:18:49.395914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application result.read() Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:18:49.398068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [parameters: {'id': 'a93b50ba33514e3fb9ca8a6a2d12b644', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.400372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:49.403841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a93b50ba33514e3fb9ca8a6a2d12b644. Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 466/945] 10.222.0.43 () {60 vars in 1140 bytes} [Fri Aug 19 16:18:49 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:49.406172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.504934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79d02f-6419-4f6d-aa3e-8820355afb8a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.509976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:49.522078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6d24-88d1-4cef-952e-ad2b99801a9c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.543838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.544475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.544753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.545021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.551966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.553714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.561489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.562113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.562399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.562676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.563386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] RBAC: Adding query filter params (interface=public, service_id=fd387876bdc74bb0a5e85df86b20bda1, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:49.563732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.565168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e109eb-39ae-4337-a069-5cc969a8da5c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-358aa605-4cf9-41db-aeb5-36ca3555ba86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:49.565757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:49.566587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:49.568035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 467/946] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:49.568560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf173-64a9-41b7-9d09-51dd65f155ea None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.568560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf173-64a9-41b7-9d09-51dd65f155ea None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.568696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daf173-64a9-41b7-9d09-51dd65f155ea None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.573103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 468/947] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:49.573741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daf173-64a9-41b7-9d09-51dd65f155ea None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.578143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 480/948] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/endpoints?service_id=fd387876bdc74bb0a5e85df86b20bda1&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:49.580620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.581178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.581672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.603477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:49.604843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:49.641316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:49.675164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 481/949] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:49.680403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.692328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daf173-64a9-41b7-9d09-51dd65f155ea None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.730957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.731597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.731884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.732160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.732838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:49.733461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.734621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf424-a4b8-4b02-ac46-43181dd93c83 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.754300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 469/950] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:49.755727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22ac0-d32c-4576-bec6-4d0a92238436 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.755836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22ac0-d32c-4576-bec6-4d0a92238436 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.756101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22ac0-d32c-4576-bec6-4d0a92238436 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.757478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 470/951] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:49.765230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.765563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.765780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.786496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:49.788189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:49.804098 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:49.828775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657b6aa-abba-42a3-adf7-c7ad10df6281 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.871941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 471/952] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:49.878902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.879792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.880220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.880664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.881430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.882989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.890609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 482/953] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:18:49.951420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.003409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.067495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f529b-f2af-4449-8fc3-9561b75da717 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.103947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.104584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.104944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.105221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.115896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:18:50.120620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:50.121630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:18:50.122502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:50.126635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 472/954] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:18:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:50.128045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.155779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.233942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f96-8b00-4b66-af75-3956ac3baa46 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.268643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82c07-71b9-4f9f-9c11-9214d7a08fde None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.269486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.270105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.270394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.270675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.271350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:50.271542 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.271679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.273473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.287547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 483/955] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:50.288965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.306771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.316945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82103b15-903e-4074-863c-ea142467928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.318170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82103b15-903e-4074-863c-ea142467928a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.318696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82103b15-903e-4074-863c-ea142467928a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.319208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82103b15-903e-4074-863c-ea142467928a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.320087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82103b15-903e-4074-863c-ea142467928a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.321758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82103b15-903e-4074-863c-ea142467928a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-82103b15-903e-4074-863c-ea142467928a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:50.332065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:50.347213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:50.348716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 473/956] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:50.349839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82103b15-903e-4074-863c-ea142467928a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.429190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81453d0-22d5-491d-98a7-20f71373122f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.475139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82103b15-903e-4074-863c-ea142467928a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.479283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.480271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.480658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.481053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.494817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.497356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.513863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.514473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.514753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.515025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.515745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:50.516046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:50.517112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:50.518491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:50.520128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:50.520128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:50.520128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:50.520336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.520430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 484/957] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:50.523385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 474/958] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:50.527065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.531055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.570208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.596674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.637507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96407-555f-4ced-853c-79f93e7c2c46 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.647124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b492-e6e1-4ce5-9a6b-7916b51c005b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.674612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.675168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.675453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.675763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.676409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:50.676718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.678429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.687760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.688746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.689342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.689893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.690786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:50.691313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.692921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.695889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 485/959] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:50.698114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.703719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 475/960] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:50.811728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edcb6-ef18-4dbe-bda0-23b591de4b6e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:50.842005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.851998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:50.857426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:50.857426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:50.857426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:50.861557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:50.863038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:50.877156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:50.878367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 16:18:50.879570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:50.882160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 486/961] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:50.888424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:50.991887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:50.998839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551efb4-a9cc-4c45-8c8c-d477bdf16be9 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:51.033822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:51.034501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.034790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.035067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.035874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:51.036185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:51.037617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:51.056323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 476/962] 10.222.0.43 () {56 vars in 1149 bytes} [Fri Aug 19 16:18:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:51.062907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:51.169645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea37316-8eef-4846-b063-7c186486dc97 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:51.205081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:51.206106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.206612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.207094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.260313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:51.277320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:51.278898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:51.387212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 487/963] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:18:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:18:51.388889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:51.497797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36473-1439-4cc9-aef6-b2b8ef4db868 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:51.533920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:51.535355 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.535877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.536348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.548242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:51.550064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:18:51.570115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:51.571124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:18:51.572053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:18:51.572053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:18:51.572053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:51.578915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 477/964] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:51.580509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:51.669924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:51.686684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f048c39-3423-45f5-88a2-a4b4b2074b56 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:51.722245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:51.722856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.723134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.723407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.724080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:51.724383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:51.725754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f77eb-008f-49d1-bd22-595e4f86bc19 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:51.738017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 488/965] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:51.743774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:51.753905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:51.854875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b187d-a9a8-4d33-a5b4-9104a890f4a0 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:51.891841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:51.892999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.893286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.893566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.895133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5c95-b0a5-4659-82c0-b61a445714c5 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.895675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5c95-b0a5-4659-82c0-b61a445714c5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.896017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a5c95-b0a5-4659-82c0-b61a445714c5 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.897553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 489/966] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:51.904948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18592-2502-4510-bc83-da861aec3e9c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:51.904948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18592-2502-4510-bc83-da861aec3e9c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:51.904948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18592-2502-4510-bc83-da861aec3e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:51.906700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:51.908426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:18:51.921475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:51.922491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:18:51.923376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:51.923866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3de18592-2502-4510-bc83-da861aec3e9c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:51.923866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3de18592-2502-4510-bc83-da861aec3e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:51.926192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 478/967] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:51.935517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.003650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 490/968] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:52.013089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.050176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06c83-98b4-4ae6-be9a-c4ca98613934 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.065216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d37d7-6a00-44d0-9bc2-6ffb3823f524 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.065498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d37d7-6a00-44d0-9bc2-6ffb3823f524 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.065832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d37d7-6a00-44d0-9bc2-6ffb3823f524 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.067730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 491/969] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:52.072772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.073159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.073599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.093545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.094174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:52.094583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.095027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.095448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.095799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:52.096521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:52.096982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.098563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.112318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 479/970] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:52.118774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.192165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 492/971] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:52.228305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7ea34-f192-4484-a3a2-80044664f1cf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.256849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.273818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.273818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.273818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.273818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.274212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] RBAC: Adding query filter params (role.id=91eb631c8571477cb225ffb15150295a, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=7ed5539c0c71499c95a31152732943c5) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:52.274212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.274212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.280189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 480/972] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/role_assignments?user.id=7ed5539c0c71499c95a31152732943c5&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=91eb631c8571477cb225ffb15150295a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:52.300981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.304882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.416917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03b4d-b904-4ac7-a34a-da83bfd0272b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.453782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.454395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.454673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.454944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.455608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.457042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.459588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING keystone.server.flask.common [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 16:18:52.475960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.541689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.sql.core [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 16:18:52.541689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 16:18:52.541689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [parameters: {'user_id': '63732cfa68284789bc7b306d4d3ce255', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 16:18:52.541689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81805) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Aug 19 16:18:52.558664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:18:52.559864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application yield resource Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application next(self.gen) Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise self.value Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application session.commit() Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 16:18:52.561113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.session.flush() Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application compat.raise_( Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 16:18:52.562619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 16:18:52.564873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application conn.query(q) Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application result.read() Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 16:18:52.567013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [parameters: {'user_id': '63732cfa68284789bc7b306d4d3ce255', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:52.569218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 16:18:52.571446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 493/973] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 16:18:52 2022] POST /identity/v3/users => generated 160 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:52.575878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.621278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ed90d-965c-4968-bdbe-3e921c4c496c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.652904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.662048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.662847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.663223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.663622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.664310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.666046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:52.675318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:52.676654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:52.677513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:52.678251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 481/974] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:52.684641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.704076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61d71-5a19-48ac-a720-ec481843ff8d None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.742067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.742705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.742987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.743265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.745903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.751977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.753635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c05b4b6c-1f1c-4fbf-8451-db869e670530 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:18:52.766132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:52.767304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 16:18:52.768289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:52.771942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 494/975] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:52.772976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d60a-12ec-4b99-88e8-33c183b74515 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.773261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d60a-12ec-4b99-88e8-33c183b74515 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.773538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d60a-12ec-4b99-88e8-33c183b74515 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.778156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 495/976] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:52.778873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270d60a-12ec-4b99-88e8-33c183b74515 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.802284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c9da-22f4-49f1-8618-1ffb0b0a6167 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.839871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.840548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.840839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.841116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.841754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:52.842060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.843439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f727309-430e-4ba1-87a0-db9ae9a02a53 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.848201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 482/977] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:52.849341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.849631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.849911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.868057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:52.869267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:52.903717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270d60a-12ec-4b99-88e8-33c183b74515 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:52.932464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:52.941875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:52.952455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:52.952905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 483/978] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:52.952905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:52.985938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 496/979] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:53.013797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:53.072603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b44be-9ff4-4a49-98b5-5c44dd9ce2ca None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:53.111504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:53.112146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:53.112433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:53.112714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:53.113366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:53.113677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:53.115092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:53.121926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 484/980] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:53.127361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:53.221442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:53.240127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c823166-4836-4a0b-aadc-ff139385415e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:53.277640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:53.278254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:53.278534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:53.278806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:53.280014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:53.281395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7d551-89e4-4fb4-821c-ce6d9cdc3ccf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:53.328210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f48f7c-2679-4c26-acad-e03576327455 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:53.341434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:53.362998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:53.363662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:53.363944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:53.364217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:53.364864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:53.366222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a630-0fc2-44f5-ba71-5cca5991a245 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:53.377685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 497/981] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:53.442310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 485/982] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:53 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:18:54.304250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4ae2e-12a1-41f4-886e-211a505ec83a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:54.304763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4ae2e-12a1-41f4-886e-211a505ec83a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:54.304877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4ae2e-12a1-41f4-886e-211a505ec83a None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:54.306284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 498/983] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:54.311926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:54.312307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:54.312482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:54.330607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:54.331826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:54.412513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 486/984] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:54.690141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4ae2e-12a1-41f4-886e-211a505ec83a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:54.736556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:54.799091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4ae2e-12a1-41f4-886e-211a505ec83a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:54.834374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:54.835063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:54.835349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:54.835696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] PATH_INFO: `/v3/services/image` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:54.836289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:54.837661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:54.847477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:54.848446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:18:54.849276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:54.850591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 499/985] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 16:18:54 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:54.854415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:54.956879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:54.961208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cb2aa-e6a4-4002-a10c-669523829292 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:54.999670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:55.000625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.001103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.001559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.002371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] RBAC: Adding query filter params (name=image) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:55.002871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:55.004493 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79a25-3807-4e34-b939-5e26000c0c75 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:55.009726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 487/986] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:55.015390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:55.115522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882345-8c61-4b6f-a6c2-6819684fa82f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:55.118222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:55.150722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:55.151370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.152271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.152549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.153174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:55.153477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:55.154845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f54ca-0e79-4823-ae07-36b5a0d184c8 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:55.167808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 500/987] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:18:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:55.334518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23440-daab-4488-bb4a-48b0391c0b37 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.335024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23440-daab-4488-bb4a-48b0391c0b37 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.335146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23440-daab-4488-bb4a-48b0391c0b37 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.336464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 488/988] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:55.342398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.342816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.343014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.364412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:55.365938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:55.383541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20064e-0255-42d0-a6eb-e8cd4b3a5047 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.383828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20064e-0255-42d0-a6eb-e8cd4b3a5047 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.384109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20064e-0255-42d0-a6eb-e8cd4b3a5047 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.385453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 489/989] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:55.390959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.391252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.391572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.410971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:55.412213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:55.443534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 501/990] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:55.486557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 490/991] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:55.719624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:55.752763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:55.826214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:55.829202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152391f-3119-4488-abf0-ba9b81ff3e68 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:55.847272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:55.856377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff0df-9b1d-4738-bf8f-6811da32025e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:55.864076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:55.864718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.865000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.865274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.865862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:55.867249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:55.875988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:55.877159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:55.878102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 502/992] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:55.882848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:55.894917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:55.895597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:55.895880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:55.896151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:55.896731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:55.898090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:55.907573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:55.908581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:55.909415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 491/993] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:55.914364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:55.993597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede4c81-3b51-4045-960b-06e6d26be27f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.019744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802e4e7-96d4-4fd5-afe2-06957b04bd76 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.030531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.031460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.031775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.032216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.032860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.033168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.034559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.039462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 503/994] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:56.045704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.060296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.061120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.061406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.061684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.062381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.062693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.064099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.069027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 492/995] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:56.074609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.079389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:56.099530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:56.155825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad82d0-1bc4-4628-8556-38012d857c9c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.185240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed940eb-dc26-4a47-b571-4a7c0f93504c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.192134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.192752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.193032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.193302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.193926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.194231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.195666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.200592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 504/996] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:56.206322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.228222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.229180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.229733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.230703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.231548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.232018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.233629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.239323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 493/997] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:56.245275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.309794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:56.319125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd6bda-0c87-4738-8a3b-fdd6ed43f923 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.337309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:56.356880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c613c-f2bf-485d-b52e-0b80a53812ae None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.362667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.363338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.363650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.363926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.364643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] RBAC: Adding query filter params (interface=admin, service_id=fd387876bdc74bb0a5e85df86b20bda1, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.364953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.366337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.371980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 505/998] 10.222.0.43 () {56 vars in 1249 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/endpoints?service_id=fd387876bdc74bb0a5e85df86b20bda1&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:56.377371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.397465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.398270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.398768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.399189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.400093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] RBAC: Adding query filter params (interface=public, service_id=074ceff97c6d4d52ae328b8560c6c61f, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:56.400565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.402867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.408480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 494/999] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/endpoints?service_id=074ceff97c6d4d52ae328b8560c6c61f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:56.413630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:56.490595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f615-952f-4acd-b61a-0823bc6d5ffd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.517989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52bc3-4668-4ef9-9974-eeb6a2675c1f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:56.529959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.530702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.530989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.531262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.532005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.533501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c66138-450b-4457-87f1-639f5eef03f4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.540332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 506/1000] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:18:56.562639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:56.563273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:56.563583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:56.563858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:56.564482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:56.565887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115603a3-f856-488b-ba83-92bd3a3212ed None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:56.579742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 495/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:18:56 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:18:57.094145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f34b-db44-4d90-a06b-3b5c8fc8faed None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:57.094486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f34b-db44-4d90-a06b-3b5c8fc8faed None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:57.094709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f34b-db44-4d90-a06b-3b5c8fc8faed None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:57.096399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 507/1002] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:57.101750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a76b-29f6-4c53-9dff-2a016d61f680 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:57.102041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a76b-29f6-4c53-9dff-2a016d61f680 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:57.102320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a76b-29f6-4c53-9dff-2a016d61f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:57.124107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-88d9a76b-29f6-4c53-9dff-2a016d61f680 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:57.125533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-88d9a76b-29f6-4c53-9dff-2a016d61f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:57.133496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:57.207869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 496/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:57.467319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f34b-db44-4d90-a06b-3b5c8fc8faed None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:57.486816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:57.570096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f34b-db44-4d90-a06b-3b5c8fc8faed None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:57.603745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:57.604357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:57.605168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:57.605447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:57.606107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:57.607500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39849c-4c6c-43d2-8088-65a3ad7c17d3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:57.692695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 508/1004] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:18:57 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:58.497410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f22d8-7182-4bc0-b904-1dde10dd641e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:58.497915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f22d8-7182-4bc0-b904-1dde10dd641e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:58.498018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f22d8-7182-4bc0-b904-1dde10dd641e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:58.499299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 497/1005] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:58.504706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:58.505253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:58.505532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:58.506085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338173-0459-4918-99db-83d96d2548d1 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:58.506379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338173-0459-4918-99db-83d96d2548d1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:58.506657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338173-0459-4918-99db-83d96d2548d1 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:58.508107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 498/1006] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:18:58.513292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:58.513578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:58.513861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:58.524728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:58.525916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:58.532905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:58.534486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:58.603362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 509/1007] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:58.608991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 499/1008] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:18:58.872497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:58.875583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:58.880235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:58.960018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:58.982210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980f29f-396f-4a92-92b3-8e0cfe76809a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:58.994290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe23a3b-efa1-44a7-826e-312215d853db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.017534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.018165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.018452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.018725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.019307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.020728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:59.030968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:59.031988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:18:59.033603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 510/1009] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 16:18:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:18:59.035715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.036355 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.036669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.037211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.037806 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.037899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.039169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:18:59.049481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:18:59.050481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:18:59.053435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 500/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:18:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:18:59.056327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.112474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.148644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66532162-80c8-45c4-9088-3d41bdf01832 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.164185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e0d9-1d07-4eb4-8844-d93f84807a92 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.185692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.186420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.186705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.186977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.187633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:59.187969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.189428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.199329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 511/1011] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:59.200207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.200752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.201364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.201647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.201917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.202554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:59.203018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.205273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.207203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.217562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 501/1012] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:59.219149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.309233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d198-3785-47eb-9067-637a8e151562 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.325600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f54cf-03e2-48b9-b18d-7e28f4a76548 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.340022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.347977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.347977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.347977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.347977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.348403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:59.348403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.348796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.354108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 512/1013] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Aug 19 16:18:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:18:59.360648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.374519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.375138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.375424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.375746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.376387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:18:59.376696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.378067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.383108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 502/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 16:18:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:18:59.388537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:59.455204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.470339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973a59-5cbb-4d4d-8c85-9e96d20ee994 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.496247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7302d-9105-4819-af61-c21b5648e728 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:59.506885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.507495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.507798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.508073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.508731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.510090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0acc2c-6edc-41c1-a71b-5ff6a6e2b3d2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.533338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:59.533949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.534233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.534509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.535242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:59.536644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:59.587741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 513/1015] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:18:59.589845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005d3f-f771-4968-963e-75cf386a7e4c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.590131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005d3f-f771-4968-963e-75cf386a7e4c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.590409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005d3f-f771-4968-963e-75cf386a7e4c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.591721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 514/1016] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:59.597164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:59.597454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:59.597840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:59.617937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:59.619172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:59.655710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 503/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:18:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:18:59.683708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.710059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 515/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:18:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:18:59.982087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:00.085112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e7725-7302-4375-96d8-2362c151a0fe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:00.106738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:00.121744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:00.122386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:00.122669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:00.122953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] PATH_INFO: `/v3/services/image` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:00.123580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:00.124953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:00.133731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:00.135060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:00.136567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:00.139139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 504/1019] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 16:18:59 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:00.141637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:00.245839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb70f6-3b95-4593-91e9-6e1fedb0ed23 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:00.280082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:00.280691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:00.280972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:00.281247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:00.281880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] RBAC: Adding query filter params (name=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:00.282184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:00.283581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:00.293344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 516/1020] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:00.294568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:00.405232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673bd7-4287-49f5-aa81-c49859872bfe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:00.440587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:00.441186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:00.441464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:00.441736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:00.442420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] RBAC: Adding query filter params (type=image) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:00.442724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:00.444175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:00.453743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 505/1021] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:00.454947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:00.504654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:00.558429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f07a1-f3c1-4878-825e-154d601a6993 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:00.593863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:00.594470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:00.594749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:00.595020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:00.595754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] RBAC: Adding query filter params (interface=public, service_id=adbaac4f5d4b4ab08202507ffd9a6773, region_id=RegionOne) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:00.596066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:00.597463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17527e7-ab41-42f4-a019-8a2043416ea1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:00.607776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 517/1022] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:19:00 2022] GET /identity/v3/endpoints?service_id=adbaac4f5d4b4ab08202507ffd9a6773&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:00.609056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:00.661495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:00.715208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3ba1-105f-404b-8d06-e7212a37f090 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:00.753530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:00.754146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:00.754428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:00.754752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:00.755307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:00.756708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fce6b1-5b33-4503-bb40-cbff6144b5a1 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:00.771802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 506/1023] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:19:00 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:19:01.545736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759fffa-da4d-4969-9e72-786c9fee02a9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:01.546042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759fffa-da4d-4969-9e72-786c9fee02a9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:01.546295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759fffa-da4d-4969-9e72-786c9fee02a9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:01.547804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 518/1024] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:01.552784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d43a-7671-466c-afee-5db5db442e41 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:01.553076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d43a-7671-466c-afee-5db5db442e41 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:01.553351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d43a-7671-466c-afee-5db5db442e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:01.571662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1ea6d43a-7671-466c-afee-5db5db442e41 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:01.572834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ea6d43a-7671-466c-afee-5db5db442e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:01.641388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 507/1025] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:01.687945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f4e1-28d3-45f8-bcae-cd4b7076c7e3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:01.688511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f4e1-28d3-45f8-bcae-cd4b7076c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:01.688511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f4e1-28d3-45f8-bcae-cd4b7076c7e3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:01.689999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 519/1026] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:01.694983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:01.695272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:01.695578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:01.714283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:01.715468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:01.751046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:01.786969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 508/1027] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:01.914547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f4e1-28d3-45f8-bcae-cd4b7076c7e3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.014350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f4e1-28d3-45f8-bcae-cd4b7076c7e3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.024502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:02.047339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.047988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.048267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.048539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.049749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.051184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.052774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 520/1028] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:02.058626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.067573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.170397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6120187-ee8a-4cfc-b779-5459bff3005d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.171740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25be0f-0c27-4a18-97ba-6b888a4fd7eb None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.207551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.208167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.208489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.208712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.209561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.210452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.211029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.211126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.211343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.211658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.223642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:02.228498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:02.229543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:02.230398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 521/1029] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:02.235332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.275721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:02.299530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 509/1030] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:19:02 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:02.342959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cdf44-209a-4049-b9ff-ef5262453c3c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.384785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.385405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.386475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.386916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.387939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:02.388251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.389668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.403688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 522/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:02.404856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.435543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:02.517281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ec89-3ba6-4421-a818-f14ba1bea807 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.550453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.551088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.551365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.551674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.562881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.564356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9944e47b-29c8-4b32-af55-0b5c17e430cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:02.578654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:02.579778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:02.580746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:02.580746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:02.580746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:02.580746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 510/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:02.585875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.676926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd4d-ef5a-4dbf-b02e-72f1abc1818c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.677453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd4d-ef5a-4dbf-b02e-72f1abc1818c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.677699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd4d-ef5a-4dbf-b02e-72f1abc1818c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.679567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 511/1033] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:19:02.686396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.686614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.686888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.688950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:02.692194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d38f16-5efb-43ff-84e7-85475ee5d492 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.705059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:02.706601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:02.730366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.730975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.731256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.731548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.732195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:02.732495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.733899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.746344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 523/1034] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:02.751916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.795514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 512/1035] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:19:02.851767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb5f39-b1bd-48ed-b388-09940b233b06 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:02.884451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:02.885078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:02.885354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:02.885629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:02.893755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:02.895200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:19:02.906621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:02.912624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:02.913609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 524/1036] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:02.914213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:02.922165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.015424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6ead8-d65b-45ea-ac17-2fb5cc032dce None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.052449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.053058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.053334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.053605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.054420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:03.054728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.055031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.056181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.080941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.081884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 513/1037] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:03.087107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.155152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.166284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faf18a-358c-4119-9094-efcedb48df0c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.193939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e44ec6-19e3-4772-93cd-9ac8954af549 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.203251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.203918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.204202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.204482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] PATH_INFO: `/v3/services/image` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.205066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.206454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:03.216109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:03.217327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:03.218159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 525/1038] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:03.222973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.235527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.236239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.236593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.236942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.309068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.310696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.311511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.328106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51b26-6ce5-42eb-850f-e2b6b815d312 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.373736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.374428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.374707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.374976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.375637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:03.375939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.376962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.377322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.383171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 526/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:03.390446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.425064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 514/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 16:19:03.430948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.500224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f993a-3a64-4fbc-9fe1-9c80ca441ad9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.537058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.537661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.537946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.538064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010398-88dc-40d9-9950-b36fd95bf64f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.538222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.538861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] RBAC: Adding query filter params (type=image) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:03.539168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.540605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.550091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 527/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:03.551076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.568627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.581024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.582065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.582640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.583083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.596782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.599074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:03.618535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:03.619743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:03.626003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:03.626003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:03.626003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:03.626345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 515/1042] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:03.627017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.647278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.659968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911b-683d-4496-97cc-9f3d7cb7f03c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.696477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.697108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.697361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.697670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.698854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.700275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.737175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424cb9-b500-4181-8f70-8b6321bfdf7d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.771148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.771788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.772073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.772349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.772994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:03.773300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.774711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.782450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 528/1043] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:19:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:03.800549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 516/1044] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:03.802081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:03.877001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:03.921149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801ccd4-b4af-4726-82df-54f535fdb275 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:03.960527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:03.961172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:03.961457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:03.961732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:03.969118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:03.970585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:19:03.981966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:03.982870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:03.983901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 529/1045] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:03.988865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:04.073050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:04.097311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b438-c608-4a0d-930c-f14bdb49c8bc None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:04.134363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:04.134882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.135162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.135435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.136917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:04.137230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:04.138658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78f06-b28d-47ab-88fa-91f03cebe5b9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:04.155410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 517/1046] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:04.157097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:04.261863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e6bb-1f26-42ee-9977-8ca6d4804f57 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:04.273210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745097bf-991b-4cbc-b570-6c9f9fd5dede None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.273465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745097bf-991b-4cbc-b570-6c9f9fd5dede None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.273733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745097bf-991b-4cbc-b570-6c9f9fd5dede None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.275209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 518/1047] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:19:04.280729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627efd26-89f5-4769-ae06-d951239bedec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.281016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627efd26-89f5-4769-ae06-d951239bedec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.281290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627efd26-89f5-4769-ae06-d951239bedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.287123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:04.299984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-627efd26-89f5-4769-ae06-d951239bedec None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:04.300839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:04.301174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-627efd26-89f5-4769-ae06-d951239bedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:04.301453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.301840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.301996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.302729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] RBAC: Adding query filter params (role.id=91eb631c8571477cb225ffb15150295a, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:04.303073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:04.304519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:04.311902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 530/1048] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:04 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=91eb631c8571477cb225ffb15150295a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:04.387624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 519/1049] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:19:04.661155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:04.765556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66f918-8780-41c6-8644-d90755f2f96c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:04.804625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:04.805254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.805531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.805802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.806895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:04.808383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa301-c18a-44a3-b244-221e42dea5cf None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:04.811530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 531/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:04.816270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627efd26-89f5-4769-ae06-d951239bedec None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:04.880469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:04.916878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627efd26-89f5-4769-ae06-d951239bedec None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:04.951938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:04.952552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:04.952829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:04.953100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:04.953734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:04.955138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66429884-dff3-4d74-b216-b7499dc990c3 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:05.044930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 520/1051] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:19:04 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:19:05.729212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8cc5-e96b-4c0f-b6f6-eb011b0f12d6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:05.730067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8cc5-e96b-4c0f-b6f6-eb011b0f12d6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:05.730259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8cc5-e96b-4c0f-b6f6-eb011b0f12d6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:05.731879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 532/1052] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:05.736831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388026f-45df-4992-aa34-10d8c3f32098 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:05.737126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388026f-45df-4992-aa34-10d8c3f32098 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:05.737407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388026f-45df-4992-aa34-10d8c3f32098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:05.755665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5388026f-45df-4992-aa34-10d8c3f32098 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:05.756849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5388026f-45df-4992-aa34-10d8c3f32098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:05.822701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 521/1053] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:06.088925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e8cc5-e96b-4c0f-b6f6-eb011b0f12d6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:06.148232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:06.196375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e8cc5-e96b-4c0f-b6f6-eb011b0f12d6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:06.231539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:06.232159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.232441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.232717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.260187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf73-a216-4f7c-922f-64c259167123 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.260478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf73-a216-4f7c-922f-64c259167123 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.260846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baf73-a216-4f7c-922f-64c259167123 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.262911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 522/1054] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:19:06.267385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.267707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.267986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.286535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:06.287736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:06.301960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:06.303415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:06.338348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:06.364534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 523/1055] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:19:06.372148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:06.417533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 533/1056] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:06.423285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:06.523988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25d985-7f53-454d-bc59-a67a5facc41a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:06.560214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:06.560853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.561129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.561395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.571433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:06.572914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:06.587824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:06.589361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:06.590283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:06.590283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:06.590283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:06.591823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 524/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:06.595361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:06.636333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:06.674304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:06.705569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa91bf-1ef7-44a3-88d9-2c6812a8385e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:06.746735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:06.747347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.747760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.747946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.748575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:06.748885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:06.748982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2c9b2-56be-493d-b00c-3a998b0994e6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:06.750362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:06.771519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 534/1058] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:06.801739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:06.802496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.802869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.803215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.817966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-314f3015-4955-4d34-a8fb-e18e5f41c11a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:06.822715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:06.824929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:06.828609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 525/1059] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:19:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:06.831137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:06.852751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:06.947347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91fb66-73e7-4199-9b0f-cbf06cd9c250 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:06.982918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:06.983573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.983862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.984140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.984812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:06.985130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:06.986516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:06.989297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a74a-22f1-4f3e-9cfb-67e9f9dd1d53 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.989587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a74a-22f1-4f3e-9cfb-67e9f9dd1d53 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.989868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a74a-22f1-4f3e-9cfb-67e9f9dd1d53 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:06.991339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 526/1060] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:19:06.995980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 535/1061] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:19:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:06.997214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:06.997507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:06.997788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.002364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.017640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:07.018842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:07.095465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.099891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 527/1062] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:19:07.116255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ccd0-7944-4d28-b6c9-c1b950fbda2e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.148621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.149238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.149517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.149789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.159887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.161333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:07.175562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:07.176618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:07.178014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:07.178014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:07.178014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:07.178014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 536/1063] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:07.182323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.207059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.278818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd70c8-2ed0-432e-ac74-8a867f85a6ef None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.312005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.312598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.312876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.313147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.313778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:07.314079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.315437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.326290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 528/1064] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:07.331981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.359567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.438042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e8ba0-ad1a-40e3-bd8a-1a8f2f7f63c0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.444408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.466030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b9ca-4864-4f09-944e-8bd6a69977ad None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.466699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.472867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.473491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.473773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.474045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.482207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.483741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.494145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:19:07.494864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:07.495870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:07.496989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:07.497768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.497768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.497768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.497999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 537/1065] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:07.501744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.510399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:07.515175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:07.516191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:07.517057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 529/1066] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:07.522003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.606506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d92ef-674b-4814-81a3-c8e04d0bd144 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.621726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb2d6-d732-4f58-bbea-831741ffeaa6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.639839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.640447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.640730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.641009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.641737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:07.642263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.643736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.655174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.655923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.659322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.659322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.659322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:07.659322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.659322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.662317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 538/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:07.668362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 530/1068] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:07.669262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.673894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.682583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.717907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.767195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0829-be25-4317-af93-a9119b5cf5ac None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.772396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e164-7043-4f2d-9b53-700f2abca889 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.801258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.801896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.802183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.802443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.807981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.808606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.808882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.809147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] PATH_INFO: `/v3/users/4faf520658a64983a387d2055e1f5a56` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.814444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.815938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.822485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] RBAC: Authorizing `identity:get_user(user_id=4faf520658a64983a387d2055e1f5a56)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.824479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.826093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 531/1069] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/users/4faf520658a64983a387d2055e1f5a56 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:07.830614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:07.836551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:07.837679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:07.837679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:07.837679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:07.837863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.837937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 539/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:07.837937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:07.891318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.927034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bcaed-87c6-44e5-9850-c4a157b909f7 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.934029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:07.937572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40451a61-0324-422e-aa63-b1405d50593a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:07.961124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.961725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.962007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.962281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.971293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:07.971874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:07.972158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:07.972438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:07.973088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:07.973393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:07.974835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:07.986809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 540/1071] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:07.992297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:08.032470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.033921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.094231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:08.094882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476ec5-47de-4fe9-aecc-32757a13b15a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:08.128706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:08.129373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:08.129614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:08.129887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:08.137732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 532/1072] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:08.137884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.137884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.138719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:19:08.149009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:08.149977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:08.150865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 541/1073] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:08.155831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:08.177413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:08.236963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec254-a824-4945-b989-4392e94717ed None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:08.254761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cbf5b-8a27-4ef3-8043-4f2da3a48a0a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:08.270790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:08.271411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:08.271716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:08.271988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:08.273091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.274511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.276681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 533/1074] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:08 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:08.282854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:08.288820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:08.289424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:08.289707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:08.289982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:08.290678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:08.290988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.293143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.304749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 542/1075] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:08.310798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:08.313434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:08.381265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a27c-81ec-4886-b560-00890a842745 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:08.395724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:08.414279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:08.414566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c8c1-d6aa-4fe1-a6c4-f6d8a21f02c1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:08.414978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:08.415255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:08.415564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:08.416291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=2114a4e543e54e9dba8883c1846c13eb, user.id=4faf520658a64983a387d2055e1f5a56) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:08.416599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.418885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39302-a227-4687-ab6a-8af03aab0147 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.424386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 534/1076] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:08 2022] GET /identity/v3/role_assignments?user.id=4faf520658a64983a387d2055e1f5a56&scope.project.id=2114a4e543e54e9dba8883c1846c13eb&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:08.451979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:08.452665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:08.452947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:08.453227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/91eb631c8571477cb225ffb15150295a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:08.455594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=91692048695d4f96ad3ef501c8863b33, role_id=91eb631c8571477cb225ffb15150295a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:08.457115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56264e16-6a72-41ac-a5a5-94923090804f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:08.531684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 543/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:19:08 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/91692048695d4f96ad3ef501c8863b33/roles/91eb631c8571477cb225ffb15150295a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:19:10.286396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d51fd-ac09-4795-92b3-b4a0aeedb6bc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.286923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d51fd-ac09-4795-92b3-b4a0aeedb6bc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.286923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d51fd-ac09-4795-92b3-b4a0aeedb6bc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.288307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 535/1078] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:10.293607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0ba7-5b7f-4996-8406-0d4985e0ad69 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.294041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0ba7-5b7f-4996-8406-0d4985e0ad69 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.294162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0ba7-5b7f-4996-8406-0d4985e0ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.312907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-26fb0ba7-5b7f-4996-8406-0d4985e0ad69 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:10.314103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26fb0ba7-5b7f-4996-8406-0d4985e0ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:10.380898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 544/1079] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:10.434393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c088-5a32-460e-a015-012916406bc0 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.435038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c088-5a32-460e-a015-012916406bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.435380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0c088-5a32-460e-a015-012916406bc0 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.436846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 536/1080] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:19:10.442051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.442341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.442621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.461430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:10.462617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:10.524985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:10.530209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 545/1081] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:10.648487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0c088-5a32-460e-a015-012916406bc0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:10.746877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:10.753650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0c088-5a32-460e-a015-012916406bc0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:10.787415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:10.788169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.788777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.789052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.799533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:10.804326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:10.805432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:10.808990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 537/1082] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:10.812200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:10.812341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:10.910717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b7670-c474-4b27-8615-e6511da9d6c1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:10.910941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75a297-affb-4486-bb35-ec51846197f5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:10.945411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:10.945818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:10.946030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.946315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.946446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:10.946591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.946726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:10.947002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:10.947698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:10.948052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:10.949428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:10.956828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:10.957662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 538/1083] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:10.961579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:10.962523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:10.963381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 546/1084] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Aug 19 16:19:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:10.964315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:10.968469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:10.986469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.028594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.070322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbdc2-c996-4212-bb33-29e7ca86d50e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.072363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb85ec-794f-4cb4-8ece-2ea3e9f34ebf None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.103342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.103977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.104897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.105317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.105536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.105944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.106202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:11.106302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.106490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] PATH_INFO: `/v3/users/4faf520658a64983a387d2055e1f5a56` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.106579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.107662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] RBAC: Authorizing `identity:get_user(user_id=4faf520658a64983a387d2055e1f5a56)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.107913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.109087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.110683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 539/1085] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:10 2022] GET /identity/v3/users/4faf520658a64983a387d2055e1f5a56 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:11.115898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 547/1086] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:19:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:11.116380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.121913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.201827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.217196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dbb66-74fa-4dea-bca6-99d39b0c15fe None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.221034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12cc8b-d07d-45b9-a855-6075e1a0a707 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.243581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.251982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.252604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.252888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.253166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.254275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.255418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.255739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.256071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.256358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.256634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.257400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 540/1087] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:11.264023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.268482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.269942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:11.284416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:11.285406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:11.286327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:11.286327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:11.286327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:11.286327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 548/1088] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:11.291428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.369131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3af4c-8902-4fc7-b3c7-10f404099b2e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.395400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784259a6-2366-4014-acec-8396404e0c48 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.404182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.404870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.405148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.405422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb/users/4faf520658a64983a387d2055e1f5a56/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.407307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] RBAC: Authorizing `identity:create_grant(project_id=2114a4e543e54e9dba8883c1846c13eb, user_id=4faf520658a64983a387d2055e1f5a56, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.408757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.428754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.429507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.429786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.430078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.430713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:11.431014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.433141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.444818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 549/1089] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:11.451210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.485617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.501921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 541/1090] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:19:11 2022] PUT /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb/users/4faf520658a64983a387d2055e1f5a56/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:19:11.555317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e92a0a-f935-4cf0-9c21-4482dd8ecea9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.592518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.593171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.593455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.593729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.601506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.603002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:19:11.616254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:11.617306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:11.618771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 550/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:11.624194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.642923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.727752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c0ec4-6b68-4b0f-bba9-645c3f370640 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.761418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.761976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.762259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.762533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.763270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:11.763610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.765038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:11.782342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 542/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:11.787821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:11.882779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:11.889398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f4e21-a795-4db9-b34a-8c5d6e84446e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:11.923579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:11.924186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:11.924469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:11.924745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:11.992300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:11.993753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.080803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:12.087525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 551/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:12.093918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:12.165204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:12.193958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9418a-8229-40b9-8f4e-7cd76ee2756f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:12.226850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:12.227510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:12.227790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:12.228065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:12.238576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:12.240054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:12.254047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:12.254987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:19:12.255927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:12.255927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:19:12.255927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:12.255927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 543/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:12.261053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:12.359528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3a86-abe8-4daf-b6b1-d626d85b967b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:12.392953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:12.393556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:12.393837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:12.394110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:12.394754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:12.395060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:12.396471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.408140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 552/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:12.413707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:12.513575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad1a4-0fa2-4607-bfbe-8e552594bf39 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:12.536485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:12.546846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:12.547462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:12.565814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:12.565814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:12.565814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:12.565814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:19:12.568224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:12.569174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:12.570070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 544/1096] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:19:12.576002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:12.632665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:12.677157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc197-3231-4930-a27e-dbcc72c24c90 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:12.710823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:12.711418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:12.711738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:12.712013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:12.712702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:12.713010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:12.714871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e801c0-8c6f-4558-a5a3-ed6fe408fe42 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.726692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 553/1097] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:12.732734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:12.832506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf37c-abdb-484a-b2fd-04d609c61d2b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:12.864946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:12.865547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:12.865827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:12.866097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:12.866821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] RBAC: Adding query filter params (role.id=91eb631c8571477cb225ffb15150295a, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=91692048695d4f96ad3ef501c8863b33) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:12.867133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:12.868654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4dc7e-7b85-4946-8c66-e96a3452bbed None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:12.875111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 545/1098] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:12 2022] GET /identity/v3/role_assignments?user.id=91692048695d4f96ad3ef501c8863b33&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=91eb631c8571477cb225ffb15150295a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:13.410713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1d83-4010-4b70-b967-7cfd758556a3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:13.411208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1d83-4010-4b70-b967-7cfd758556a3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:13.411321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db1d83-4010-4b70-b967-7cfd758556a3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:13.412653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 554/1099] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:13.418837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:13.419244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:13.419386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:13.439043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:13.440309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:13.486262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:13.509577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 546/1100] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:13.779229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db1d83-4010-4b70-b967-7cfd758556a3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:13.877096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db1d83-4010-4b70-b967-7cfd758556a3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:13.891297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:13.911597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:13.912255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:13.912540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:13.912815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:13.923277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:13.928044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:13.929102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:13.930150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 555/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:13.935506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:14.030996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe72e2a-1350-4af0-adb5-0a5d8edf669c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:14.065126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:14.065729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:14.066011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:14.066287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:14.066950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:14.067258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:14.068660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:14.076505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 547/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:14.082322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:14.185016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14563-880b-4e2d-ad08-1f47552875ad None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:14.218149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:14.218771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:14.219056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:14.219333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] PATH_INFO: `/v3/users/4faf520658a64983a387d2055e1f5a56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:14.220487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] RBAC: Authorizing `identity:get_user(user_id=4faf520658a64983a387d2055e1f5a56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:14.221927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:14.223511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 556/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:14 2022] GET /identity/v3/users/4faf520658a64983a387d2055e1f5a56 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:14.230331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:14.270929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:14.328053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464d6f-d44d-4ebb-b27c-d3c9b5f86c70 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:14.361926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:14.362539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:14.362823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:14.363101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:14.428188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:14.429633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:14.468726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:14.525385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 548/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:14.531974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:14.574847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:14.630140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d61da3-ca71-4762-aa4d-594719088f06 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:14.662983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:14.663632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:14.663916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:14.664193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:14.665297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:14.666822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c2c6-f54f-485f-89d5-4b81db40b870 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:14.668650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 557/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:14 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:14.674726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:14.771458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657461b2-ea57-471b-a9d3-85eda91a098e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:14.805915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:14.806509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:14.806789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:14.807062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:14.808121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=2114a4e543e54e9dba8883c1846c13eb, user.id=4faf520658a64983a387d2055e1f5a56) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:14.808432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:14.810088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc1943-7679-456d-8f2a-2932b907f11f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:14.815688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 549/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:14 2022] GET /identity/v3/role_assignments?user.id=4faf520658a64983a387d2055e1f5a56&scope.project.id=2114a4e543e54e9dba8883c1846c13eb&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:16.752662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53457c-0fe8-4aaf-95f6-9ef5b96fbed1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:16.753197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53457c-0fe8-4aaf-95f6-9ef5b96fbed1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:16.753197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53457c-0fe8-4aaf-95f6-9ef5b96fbed1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:16.754466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 558/1107] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:16.759624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:16.760025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:16.760174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:16.768327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:16.778755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:16.779983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:16.847410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 550/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:17.116676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53457c-0fe8-4aaf-95f6-9ef5b96fbed1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:17.217552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53457c-0fe8-4aaf-95f6-9ef5b96fbed1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:17.227670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:17.250431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:17.251046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:17.251331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:17.251642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:17.252757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:17.254204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45480515-27c6-4419-a821-94c0e895d85a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:17.255800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 559/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:17.261706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:17.359245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415a14c-f9d4-4202-95f0-ced9ac146726 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:17.397735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:17.398274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:17.398559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:17.398836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:17.399513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:17.401433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115846fc-4bde-4932-8646-736ef1bd5317 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:17.409451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:17.523826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 551/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:19:17 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:19:19.492377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901e52-62e3-469c-a22a-9af214787761 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:19.492939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901e52-62e3-469c-a22a-9af214787761 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:19.492939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901e52-62e3-469c-a22a-9af214787761 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:19.494274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 560/1111] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:19.499605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:19.500000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:19.500153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:19.517627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:19.518794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:19.582998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 552/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:19.859178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901e52-62e3-469c-a22a-9af214787761 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:19.959764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901e52-62e3-469c-a22a-9af214787761 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:19.993787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:19.994402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:19.994680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:19.994953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] PATH_INFO: `/v3/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:19.996519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] RBAC: Authorizing `identity:get_role(role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:19.997893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:19.999189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 561/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:19 2022] GET /identity/v3/roles/c5d478f6f3b741fe926104027a3c5529 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:20.005207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:20.108738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e194-e354-4f0c-a6ac-87c7cf78b1a8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:20.127949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:20.141867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:20.142499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:20.142782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:20.143058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] PATH_INFO: `/v3/users/08adb975dbf345df96ea1af13553c49a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:20.157100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] RBAC: Authorizing `identity:get_user(user_id=08adb975dbf345df96ea1af13553c49a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:20.158575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:20.160378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 553/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:20 2022] GET /identity/v3/users/08adb975dbf345df96ea1af13553c49a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:20.166315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:20.212759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:20.264742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84860-ca3a-4767-b7d9-020bcdd33ab0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:20.296527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:20.297123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:20.297402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:20.297672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:20.363318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:20.364812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:20.409155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:20.461408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 562/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:20.467265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:20.564095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-72c2-4d63-8ed7-7af75e7f4af4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:20.596460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:20.597077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:20.597359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:20.597629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:20.598731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:20.600184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf557e6-d304-4925-a27b-f7f0de9febbd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:20.601784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 554/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:20 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:20.608929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:20.704297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c54ff4-0c5a-4949-b897-f2d1aa73e8f1 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:20.736480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:20.737061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:20.737336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:20.737605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:20.738316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=2114a4e543e54e9dba8883c1846c13eb, user.id=08adb975dbf345df96ea1af13553c49a) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:20.738623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:20.740086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7f50d-b9f0-4c9c-8938-51a41de4f695 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:20.745176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 563/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:20 2022] GET /identity/v3/role_assignments?user.id=08adb975dbf345df96ea1af13553c49a&scope.project.id=2114a4e543e54e9dba8883c1846c13eb&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:22.581648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6c378-0ad0-4224-86ae-331276187d16 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:22.582224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6c378-0ad0-4224-86ae-331276187d16 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:22.582224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6c378-0ad0-4224-86ae-331276187d16 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:22.583552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 555/1118] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:22.588548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:22.588954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:22.589094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:22.608672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:22.609775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:22.612454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:22.673947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 564/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:22.937149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6c378-0ad0-4224-86ae-331276187d16 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:22.984188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:23.037112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6c378-0ad0-4224-86ae-331276187d16 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:23.071034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:23.071684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:23.071963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:23.072233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] PATH_INFO: `/v3/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:23.073603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] RBAC: Authorizing `identity:get_role(role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:23.075148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:23.076490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 556/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:22 2022] GET /identity/v3/roles/c5d478f6f3b741fe926104027a3c5529 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:23.082406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:23.177878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf6108-7606-4ecb-8ba6-38748f731b9f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:23.210749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:23.211313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:23.211627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:23.211906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] PATH_INFO: `/v3/users/08adb975dbf345df96ea1af13553c49a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:23.213019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] RBAC: Authorizing `identity:get_user(user_id=08adb975dbf345df96ea1af13553c49a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:23.214984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:23.216581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 565/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:23 2022] GET /identity/v3/users/08adb975dbf345df96ea1af13553c49a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:23.222653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:23.319091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36528446-faf0-49aa-8b1b-51e7196ea523 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:23.332610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:23.352495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:23.353160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:23.353450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:23.353731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:23.354860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:23.357058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98bae-d744-4c98-85df-f3efdba5343d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:23.358737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 557/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:23 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:23.364765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:23.375992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:23.462663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1a009-5603-43e8-80cd-b8db930e9d73 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:23.495663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:23.496747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:23.497030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:23.497306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb/users/08adb975dbf345df96ea1af13553c49a/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:23.499443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2114a4e543e54e9dba8883c1846c13eb, user_id=08adb975dbf345df96ea1af13553c49a, role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:23.500930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b50b40-2fe5-4876-b1b0-6f16a67557d0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:23.575301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 566/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:19:23 2022] PUT /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb/users/08adb975dbf345df96ea1af13553c49a/roles/c5d478f6f3b741fe926104027a3c5529 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:19:25.456833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cdb9-d34b-4f8b-947d-b723ea3d2fb5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:25.457381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cdb9-d34b-4f8b-947d-b723ea3d2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:25.457381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cdb9-d34b-4f8b-947d-b723ea3d2fb5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:25.458734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 558/1124] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:25.463998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:25.464464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:25.464640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:25.482276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:25.483471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:25.543709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:25.548978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 567/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:25.824818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5cdb9-d34b-4f8b-947d-b723ea3d2fb5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:25.921572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5cdb9-d34b-4f8b-947d-b723ea3d2fb5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:25.953974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:25.954592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:25.954870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:25.955141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] PATH_INFO: `/v3/roles/c5d478f6f3b741fe926104027a3c5529` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:25.956525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] RBAC: Authorizing `identity:get_role(role_id=c5d478f6f3b741fe926104027a3c5529)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:25.957881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:25.959167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 559/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:25 2022] GET /identity/v3/roles/c5d478f6f3b741fe926104027a3c5529 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:25.965627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:26.061614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917630-97e8-4d6c-8cf8-b1dbebda9457 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:26.096055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:26.096611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:26.096890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:26.097159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] PATH_INFO: `/v3/users/08adb975dbf345df96ea1af13553c49a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:26.098267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] RBAC: Authorizing `identity:get_user(user_id=08adb975dbf345df96ea1af13553c49a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:26.099728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:26.101294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 568/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:25 2022] GET /identity/v3/users/08adb975dbf345df96ea1af13553c49a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:26.107750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:26.159493 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:26.207175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17975-f0c3-4cfe-bf9c-f82d9d43ca4c None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:26.239071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:26.239688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:26.239967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:26.240237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:26.310460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:26.311918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:26.358077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:26.406713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 560/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:26.412741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:26.479329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:26.514875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ce81-9bf0-4941-b440-dda581777e1e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:26.547494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:26.548131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:26.548413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:26.548688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] PATH_INFO: `/v3/projects/2114a4e543e54e9dba8883c1846c13eb` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:26.549801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2114a4e543e54e9dba8883c1846c13eb)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:26.551233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05f65-554c-4bd2-942c-88cfcd9681b4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:26.552881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 569/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:26 2022] GET /identity/v3/projects/2114a4e543e54e9dba8883c1846c13eb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:26.559899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:26.654123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602fa3f-f61c-4e05-8eb2-9caed89bc7f2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:26.688492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:26.689226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:26.689503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:26.689775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:26.690483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] RBAC: Adding query filter params (role.id=c5d478f6f3b741fe926104027a3c5529, scope.project.id=2114a4e543e54e9dba8883c1846c13eb, user.id=08adb975dbf345df96ea1af13553c49a) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:26.690789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:26.692215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455b91-fbfe-4889-80d9-942c2d22576a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:26.697755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 561/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:26 2022] GET /identity/v3/role_assignments?user.id=08adb975dbf345df96ea1af13553c49a&scope.project.id=2114a4e543e54e9dba8883c1846c13eb&role.id=c5d478f6f3b741fe926104027a3c5529 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:19:28.633306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40039-f3ae-496d-90a4-fb41192fc284 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:28.633306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40039-f3ae-496d-90a4-fb41192fc284 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:28.633306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40039-f3ae-496d-90a4-fb41192fc284 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:28.633306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 570/1131] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:28.638567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:28.639039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:28.639147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:28.657739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:28.658913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:28.668642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:28.723667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 562/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:28.990891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d40039-f3ae-496d-90a4-fb41192fc284 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:29.105681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d40039-f3ae-496d-90a4-fb41192fc284 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:29.139122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:29.139767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:29.140048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:29.140324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:29.141433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:29.142875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc503d-432e-48e4-b4b4-9e3a2c46527d None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:29.144471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 571/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:29.150332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:29.246486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f6d9-2bda-4d99-aafa-53365dbce6c9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:29.279216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:29.279830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:29.280110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:29.280380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:29.281019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:29.282424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc2c8-1de0-42de-8be0-c53aff9e9a8e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:29.297217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:29.377013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 563/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:19:29 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:31.300823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96bf5-b7ac-4b34-ae42-cad1023e8461 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:31.301353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96bf5-b7ac-4b34-ae42-cad1023e8461 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:31.301464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96bf5-b7ac-4b34-ae42-cad1023e8461 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:31.302722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 572/1135] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:31.308688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:31.309056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:31.309607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:31.327311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:31.328605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:31.394898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 564/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:31.669913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96bf5-b7ac-4b34-ae42-cad1023e8461 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:31.672932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:31.770157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96bf5-b7ac-4b34-ae42-cad1023e8461 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:31.804016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:31.804630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:31.804913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:31.805190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:31.806307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:31.807780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e40ba-aedc-49f8-bc54-b2182a1c4e73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:31.809623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 573/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:19:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:31.815513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:31.911115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a6c8d-f00c-4137-bfdd-69a5103685e5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:31.935772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:31.943897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:31.944497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:31.954809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:31.954809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:31.954809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:31.954809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761469-0722-4fc8-8b3c-bb45987b210c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:32.026463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 565/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:19:31 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:33.949711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb108-6b00-49fc-b7ac-27cbdc2547b3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:33.950258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb108-6b00-49fc-b7ac-27cbdc2547b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:33.950258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb108-6b00-49fc-b7ac-27cbdc2547b3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:33.951697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 574/1139] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:33.956773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:33.957161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:33.957333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:33.975458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:33.976665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:34.040478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 566/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:34.308373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb108-6b00-49fc-b7ac-27cbdc2547b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:34.379296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:34.410872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb108-6b00-49fc-b7ac-27cbdc2547b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:34.444164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:34.444789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:34.445070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:34.445343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:34.456006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:34.460736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:34.461895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:34.462971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 575/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:34.468277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:34.567646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e677d0-b37a-4dbd-a4f0-dcc52bb30dd3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:34.581801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:34.602025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:34.602618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:34.602900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:34.603176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:34.603866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:34.604173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:34.605861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:34.614565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 567/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:34.620935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:34.720940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd4a-ad4a-40dd-b9bf-2571d539f7d6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:34.749594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:34.756237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:34.756865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:34.757147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:34.757419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] PATH_INFO: `/v3/users/ffc55ef5bcd84e32bfe4d76709489c57` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:34.771556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] RBAC: Authorizing `identity:get_user(user_id=ffc55ef5bcd84e32bfe4d76709489c57)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:34.773003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:34.774835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 576/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:34 2022] GET /identity/v3/users/ffc55ef5bcd84e32bfe4d76709489c57 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:34.780687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:34.885439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1c2b-7b8a-4f95-bd2a-b531b0092090 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:34.916813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:34.917923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:34.918199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:34.918467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:34.958770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:34.982608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:34.984057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:35.079977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 568/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:35.086074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:35.184439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087513a-a5d7-4eb6-bec0-b0093c178cab None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:35.217245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:35.217867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:35.218149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:35.218423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] PATH_INFO: `/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:35.219562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd4ddbb2177d43309f6a5116b4c16fb7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:35.221289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11254304-661c-472b-b449-ddbb79479cb7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:35.222915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 577/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:35 2022] GET /identity/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:35.229054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:35.301144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:35.325442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86886-8d27-4972-9c2c-28ce9bfc3864 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:35.359712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:35.360316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:35.360592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:35.360862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:35.361591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=cd4ddbb2177d43309f6a5116b4c16fb7, user.id=ffc55ef5bcd84e32bfe4d76709489c57) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:35.361899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:35.363316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d8dc3-98ad-4ff2-b74d-7921150a5dca None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:35.368594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 569/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:35 2022] GET /identity/v3/role_assignments?user.id=ffc55ef5bcd84e32bfe4d76709489c57&scope.project.id=cd4ddbb2177d43309f6a5116b4c16fb7&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:37.244613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6f5a1-0cb8-4a0c-af4d-2e1ec276b572 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:37.245179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6f5a1-0cb8-4a0c-af4d-2e1ec276b572 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:37.245179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6f5a1-0cb8-4a0c-af4d-2e1ec276b572 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:37.247103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 578/1147] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:37.252415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:37.252836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:37.252976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:37.270581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:37.271807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:37.336931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 570/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:37.603600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6f5a1-0cb8-4a0c-af4d-2e1ec276b572 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:37.662352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:37.706305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6f5a1-0cb8-4a0c-af4d-2e1ec276b572 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:37.738224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:37.738846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:37.739129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:37.739408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:37.750454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:37.755138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:37.756265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:37.757236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 579/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:37.763031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:37.827300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:37.859251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4a449-7e6b-477d-8c8d-11426af8495f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:37.892609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:37.893204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:37.893482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:37.893753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:37.894406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:37.894707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:37.896099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:37.904032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 571/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:37.909816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:38.006358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28d6-d1fd-4b1b-abe9-810077893f81 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:38.021423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:38.038469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:38.039083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:38.039366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:38.039677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] PATH_INFO: `/v3/users/ffc55ef5bcd84e32bfe4d76709489c57` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:38.040793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] RBAC: Authorizing `identity:get_user(user_id=ffc55ef5bcd84e32bfe4d76709489c57)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:38.042835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:38.045136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 580/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:37 2022] GET /identity/v3/users/ffc55ef5bcd84e32bfe4d76709489c57 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:38.050467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:38.146930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f4e5-387a-4adb-b74a-7b7c73a65a56 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:38.174448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:38.179715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:38.180325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:38.180601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:38.180915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] PATH_INFO: `/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:38.182014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=cd4ddbb2177d43309f6a5116b4c16fb7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:38.183725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de3153-e88b-42f5-bff2-ae699c634eb9 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:38.185571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 572/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:38 2022] GET /identity/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:38.191470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:38.288023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49118d44-38e6-48d0-9602-6f2687db083b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:38.320598 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:38.321244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:38.321527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:38.321807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] PATH_INFO: `/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7/users/ffc55ef5bcd84e32bfe4d76709489c57/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:38.323735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd4ddbb2177d43309f6a5116b4c16fb7, user_id=ffc55ef5bcd84e32bfe4d76709489c57, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:38.325178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f101288-3ffe-43ca-9089-d14e33895e63 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:38.381214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 581/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:19:38 2022] PUT /identity/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7/users/ffc55ef5bcd84e32bfe4d76709489c57/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:19:40.256793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5864b-8ef3-4d22-b0c0-637ac826209f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:40.257349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5864b-8ef3-4d22-b0c0-637ac826209f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:40.257349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5864b-8ef3-4d22-b0c0-637ac826209f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:40.258672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 573/1154] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:40.264391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:40.264830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:40.264951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:40.282806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:40.284023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:40.325063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:40.350492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 582/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:40.622768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5864b-8ef3-4d22-b0c0-637ac826209f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:40.723308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5864b-8ef3-4d22-b0c0-637ac826209f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:40.759795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:40.760423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:40.760704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:40.761070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:40.772064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:40.777036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:40.778113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:40.779135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 574/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:40.784251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:40.884471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d426-9429-49c3-b2a9-515ecf227f71 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:40.916939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:40.918315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:40.918598 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:40.918867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:40.919545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:40.919851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:40.921240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:40.928941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 583/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:40.935726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:40.991665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:41.031987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c14f9-afa6-4de8-a134-49be66ca74b2 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:41.064789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:41.065410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:41.065691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:41.065965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] PATH_INFO: `/v3/users/ffc55ef5bcd84e32bfe4d76709489c57` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:41.067067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] RBAC: Authorizing `identity:get_user(user_id=ffc55ef5bcd84e32bfe4d76709489c57)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:41.068536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:41.070090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 575/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:40 2022] GET /identity/v3/users/ffc55ef5bcd84e32bfe4d76709489c57 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:41.076005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:41.110244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:41.173706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbdf9b-6390-4444-b2c7-bb42069aa4db None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:41.206112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:41.206713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:41.206992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:41.207262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:41.271058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:41.272560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:41.304238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:41.367730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 584/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:41.374078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:41.474700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f2748-8d11-4a21-b904-eac2552b5fbb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:41.499542 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:41.507960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:41.508582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:41.508863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:41.509142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] PATH_INFO: `/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:41.510246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] RBAC: Authorizing `identity:get_project(project_id=cd4ddbb2177d43309f6a5116b4c16fb7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:41.512309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812843-1086-42fb-94fe-9a70c50dda4f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:41.513913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 576/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:41 2022] GET /identity/v3/projects/cd4ddbb2177d43309f6a5116b4c16fb7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:41.520103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:41.616151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e5ce-e491-4009-8b99-911dc52a7e84 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:41.648526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:41.649119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:41.649405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:41.649683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:41.650406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=cd4ddbb2177d43309f6a5116b4c16fb7, user.id=ffc55ef5bcd84e32bfe4d76709489c57) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:41.650723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:41.652270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c3347-c039-4704-b12a-27cce0138aa2 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:41.655014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:41.658167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 585/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:41 2022] GET /identity/v3/role_assignments?user.id=ffc55ef5bcd84e32bfe4d76709489c57&scope.project.id=cd4ddbb2177d43309f6a5116b4c16fb7&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:43.553551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7c0b-fc37-48d7-bc89-a4d473ec7216 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:43.554084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7c0b-fc37-48d7-bc89-a4d473ec7216 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:43.554084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7c0b-fc37-48d7-bc89-a4d473ec7216 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:43.555433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 577/1162] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:43.561044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:43.561436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:43.561603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:43.579234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:43.580470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:43.645694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 586/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:43.912424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7c0b-fc37-48d7-bc89-a4d473ec7216 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:44.012298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7c0b-fc37-48d7-bc89-a4d473ec7216 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:44.044941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:44.045560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:44.045841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:44.046116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:44.104238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:44.111499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:44.112945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:44.209448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 578/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:44.215459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:44.312684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34b4f1-5b92-46f0-a053-e8d5e7c0597c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:44.340229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:44.345859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:44.346486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:44.346794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:44.350606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:44.353834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:44.355383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-86205370-5a94-4caf-9081-51264206cee4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:44.366945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:44.368317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:19:44.369263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 587/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:19:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:44.374624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:44.466076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:44.472447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed5bf-56e8-4a7f-85d6-cfcfccdae252 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:44.505995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:44.506592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:44.506872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:44.507144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:44.507809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:44.508112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:44.509473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371ead4-a6b5-4a16-b5f9-60ebf4d902fa None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:44.517112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 579/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Fri Aug 19 16:19:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:46.407882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c473f-a060-4e3c-b1ad-76539abfb709 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:46.408405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c473f-a060-4e3c-b1ad-76539abfb709 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:46.408405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c473f-a060-4e3c-b1ad-76539abfb709 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:46.409768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 588/1167] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:46.414846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22ca-a9cc-468c-a2f0-2b3fa7723bee None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:46.415261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22ca-a9cc-468c-a2f0-2b3fa7723bee None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:46.415407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d22ca-a9cc-468c-a2f0-2b3fa7723bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:46.433185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e17d22ca-a9cc-468c-a2f0-2b3fa7723bee None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:46.435201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e17d22ca-a9cc-468c-a2f0-2b3fa7723bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:46.500876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 580/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:46.778099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c473f-a060-4e3c-b1ad-76539abfb709 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:46.875703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c473f-a060-4e3c-b1ad-76539abfb709 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:46.908312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:46.908899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:46.909178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:46.909450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:46.910106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:46.911458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0824687-88d3-476d-84f1-cb14295c648a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:46.999688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 589/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Fri Aug 19 16:19:46 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:48.882842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390727f-49ab-44d5-8a95-08e5c0531a46 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:48.883360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390727f-49ab-44d5-8a95-08e5c0531a46 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:48.883360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390727f-49ab-44d5-8a95-08e5c0531a46 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:48.884751 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 581/1170] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:48.890081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:48.890486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:48.890643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:48.908823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:48.910011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:48.954885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:48.975869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 590/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:49.256995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390727f-49ab-44d5-8a95-08e5c0531a46 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:49.343347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:49.356486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390727f-49ab-44d5-8a95-08e5c0531a46 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:49.390711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:49.391330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:49.391653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:49.391933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] PATH_INFO: `/v3/domains/25535d5be7324ff2a05f0307116117fa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:49.402450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=25535d5be7324ff2a05f0307116117fa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:49.404084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dda27-6b7d-4f4e-9568-c54ddb034bf7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:49.405659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 582/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Fri Aug 19 16:19:49 2022] GET /identity/v3/domains/25535d5be7324ff2a05f0307116117fa => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:49.411478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:49.508721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78d95b-9ec4-4af2-9c92-66b7fd70bfcc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:49.541896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:49.542495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:49.543808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:49.544094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:49.544737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:49.546171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ebcfd-f599-45d1-8d66-f3b1a69ce587 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:49.632756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 591/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:19:49 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:51.548406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101763-7b3b-4cb1-a808-a326cec886db None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:51.548924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101763-7b3b-4cb1-a808-a326cec886db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:51.548924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101763-7b3b-4cb1-a808-a326cec886db None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:51.550277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 583/1174] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:51.555637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:51.556001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:51.556203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:51.574769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:51.575975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:51.601668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:51.640553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 592/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:51.915352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0101763-7b3b-4cb1-a808-a326cec886db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:52.015800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0101763-7b3b-4cb1-a808-a326cec886db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:52.047793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:52.048409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:52.048689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:52.048966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] PATH_INFO: `/v3/domains/25535d5be7324ff2a05f0307116117fa` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:52.050073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=25535d5be7324ff2a05f0307116117fa)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:52.051530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac7cfd-20e5-48c8-b890-4987bf476768 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:52.053076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 584/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Fri Aug 19 16:19:51 2022] GET /identity/v3/domains/25535d5be7324ff2a05f0307116117fa => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:52.058811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:52.155185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f09f-1482-4e26-9b8a-7989498a9045 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:52.188315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:52.188844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:52.189121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:52.189391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:52.190038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:52.191458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ca7b0-38e0-4deb-9b6c-bca8f2e1b903 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:52.300959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 593/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:19:52 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:19:54.225041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b624-21ab-449e-ba3e-31f134c108e7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:54.225589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b624-21ab-449e-ba3e-31f134c108e7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:54.225589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b624-21ab-449e-ba3e-31f134c108e7 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:54.226925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 585/1178] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:54.232633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:54.233059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:54.233185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:54.250545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:54.251752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:54.264964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:54.316385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 594/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:54.585520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b624-21ab-449e-ba3e-31f134c108e7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:54.604362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:54.687156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b624-21ab-449e-ba3e-31f134c108e7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:54.788028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:54.788646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:54.788929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:54.789204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:54.800536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:54.805242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:54.809774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:54.810874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 586/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:54.813437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:54.909677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0016d4f-728d-4075-9974-2f81a800c17a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:54.944575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:54.945171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:54.945453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:54.945730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:54.946393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:54.946701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:54.948113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:54.956309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 595/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:54.962029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:55.036404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:55.057604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826c3d-9867-4312-a6ed-aae53961eb6b None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:55.090099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:55.091411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:55.091712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:55.091987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] PATH_INFO: `/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:55.104450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f4d3df54ec42cfaa0fbeabdf11b03d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:55.105985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:55.107621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 587/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:54 2022] GET /identity/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:55.113472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:55.126137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:55.212659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92ffc-155d-495d-a961-ac6458c7ae6a None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:55.244442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:55.245034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:55.245297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:55.245567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:55.309536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:55.310971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:55.321325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:55.406161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 596/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:19:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:19:55.412070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:55.514141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161e9e-b043-48d0-a933-a48ff55a3100 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:55.549538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:55.550169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:55.550451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:55.550727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] PATH_INFO: `/v3/projects/77eedf1e30e240368939f93cec8dde65` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:55.551902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] RBAC: Authorizing `identity:get_project(project_id=77eedf1e30e240368939f93cec8dde65)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:55.553344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec89b-3195-4243-8f55-7dc31fec5717 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:55.554976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 588/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:55 2022] GET /identity/v3/projects/77eedf1e30e240368939f93cec8dde65 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:55.562253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:55.658533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ca73b-b592-48bc-bf2d-ed02d74aebee None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:55.669501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:55.692583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:55.693178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:55.693459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:55.693733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:55.694453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=77eedf1e30e240368939f93cec8dde65, user.id=e9f4d3df54ec42cfaa0fbeabdf11b03d) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:55.694766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:55.696222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1ff72-36bd-4937-8fbc-5ee05004cdef None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:55.702497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 597/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:19:55 2022] GET /identity/v3/role_assignments?user.id=e9f4d3df54ec42cfaa0fbeabdf11b03d&scope.project.id=77eedf1e30e240368939f93cec8dde65&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:57.558701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd827-7581-487d-8e8e-3e460f9ba314 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:57.561019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd827-7581-487d-8e8e-3e460f9ba314 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:57.561298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd827-7581-487d-8e8e-3e460f9ba314 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:57.562650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 589/1186] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:19:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:19:57.567856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:57.568259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:57.568412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:57.586529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:19:57.587748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:57.651906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 598/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:19:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:19:57.914448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdd827-7581-487d-8e8e-3e460f9ba314 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:57.917287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:58.011317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdd827-7581-487d-8e8e-3e460f9ba314 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:58.043892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:58.044494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:58.044772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:58.045043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:58.054655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:19:58.059691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:19:58.060782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:19:58.061668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 590/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:19:58.066656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:58.162180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3442-7529-44aa-a0a4-9c7bee6c9ced None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:58.164517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:58.194413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:58.195009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:58.195293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:58.195595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:58.196340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:19:58.196669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:58.198048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:58.206724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 599/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:58.212393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:58.271972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:58.309348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca981e-2537-483b-9b70-59696e93fd4e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:58.342208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:58.342822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:58.343100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:58.343371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] PATH_INFO: `/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:58.344505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f4d3df54ec42cfaa0fbeabdf11b03d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:58.345925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:58.347495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 591/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:19:58 2022] GET /identity/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:58.353684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:58.452101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1538197-5a7f-47d9-b509-0b9704106cd0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:58.484447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:58.485073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:58.485360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:58.485641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] PATH_INFO: `/v3/projects/77eedf1e30e240368939f93cec8dde65` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:58.486754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] RBAC: Authorizing `identity:get_project(project_id=77eedf1e30e240368939f93cec8dde65)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:58.488229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc085d-7922-45bd-a610-196e099e92a0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:58.489849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 600/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:19:58 2022] GET /identity/v3/projects/77eedf1e30e240368939f93cec8dde65 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:19:58.495826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:58.593426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3556-896d-4b05-840b-6634815ac670 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:58.621091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:58.626913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:58.627592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:58.627874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:58.628146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] PATH_INFO: `/v3/projects/77eedf1e30e240368939f93cec8dde65/users/e9f4d3df54ec42cfaa0fbeabdf11b03d/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:58.630025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=77eedf1e30e240368939f93cec8dde65, user_id=e9f4d3df54ec42cfaa0fbeabdf11b03d, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:58.631447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434933e9-0ed7-4c47-b546-8e38b7b13a3d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:58.694134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 592/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:19:58 2022] PUT /identity/v3/projects/77eedf1e30e240368939f93cec8dde65/users/e9f4d3df54ec42cfaa0fbeabdf11b03d/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:20:00.542360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fe-db23-4a7d-bc84-667e77d5cbf1 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:00.542867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fe-db23-4a7d-bc84-667e77d5cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:00.542978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fe-db23-4a7d-bc84-667e77d5cbf1 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:00.545155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 601/1193] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:20:00.550146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:00.550528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:00.550696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:00.568999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:20:00.570167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:00.635539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 593/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:20:00.901292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e719fe-db23-4a7d-bc84-667e77d5cbf1 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:00.938044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:01.000960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e719fe-db23-4a7d-bc84-667e77d5cbf1 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.033690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.034304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.034581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.034852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.044574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:20:01.049220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:20:01.050304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:20:01.051400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 602/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:20:01.056349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:01.151768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851182e0-77bc-4cc6-b0dc-116f100d1792 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.171316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:01.185312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.185911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.186189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.186459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.187113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:20:01.187410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:01.188792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:01.197540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 594/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:20:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:20:01.203079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:01.294290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:01.300663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11df615-a262-4e7e-bf13-dd12e1e2c1ca None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.334933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.335575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.335858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.336132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] PATH_INFO: `/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.337239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] RBAC: Authorizing `identity:get_user(user_id=e9f4d3df54ec42cfaa0fbeabdf11b03d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:01.338669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:01.341114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 603/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 16:20:01 2022] GET /identity/v3/users/e9f4d3df54ec42cfaa0fbeabdf11b03d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:20:01.346899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:01.444049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4b00-b92a-43eb-b56c-63bd0cbf3ef4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.476770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.477370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.477650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.477922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.525615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:01.543183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:01.544647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:01.640188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 595/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:20:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:20:01.646258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:01.745182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71739b1-b6b7-47dd-aedc-1e4d0ee746df None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.778090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.778702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.778988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.779262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] PATH_INFO: `/v3/projects/77eedf1e30e240368939f93cec8dde65` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.780408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] RBAC: Authorizing `identity:get_project(project_id=77eedf1e30e240368939f93cec8dde65)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:01.781848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c2b7-a57e-4293-a842-41938dcebb14 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:01.783592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 604/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 16:20:01 2022] GET /identity/v3/projects/77eedf1e30e240368939f93cec8dde65 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:20:01.789596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:01.869128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:01.887506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f69f1-8935-4a95-906e-55508acb2303 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:01.920371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:01.920962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:01.921247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:01.921572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:01.922497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=77eedf1e30e240368939f93cec8dde65, user.id=e9f4d3df54ec42cfaa0fbeabdf11b03d) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:20:01.922983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:01.924807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7cef-e322-4bdd-a4e2-2b81f31d1b72 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:01.930401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 596/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:20:01 2022] GET /identity/v3/role_assignments?user.id=e9f4d3df54ec42cfaa0fbeabdf11b03d&scope.project.id=77eedf1e30e240368939f93cec8dde65&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:20:11.774048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:11.927859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=27 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:15.006650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766b2e-26fc-439b-8d92-6a195c8e76a9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:15.007238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766b2e-26fc-439b-8d92-6a195c8e76a9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:15.007238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766b2e-26fc-439b-8d92-6a195c8e76a9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:15.009403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 605/1201] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:21:15.014560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:15.014975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:15.015116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:15.033782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:15.034952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:15.105863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 597/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:15.392026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766b2e-26fc-439b-8d92-6a195c8e76a9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:15.494381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766b2e-26fc-439b-8d92-6a195c8e76a9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:15.527676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:15.528357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:15.528636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:15.528909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:15.538566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:15.540038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:15.553937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:15.555263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:15.556984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:15.556984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:15.556984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:15.556984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 606/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:15.561824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:15.660308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d199-9a44-47c0-ba68-35f3c7f172b1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:15.688660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:15.694560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:15.699073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47350f37-9d8e-4388-8055-bc1b8f975b78 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:15.714371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 598/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:15.720292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:15.777751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:15.824336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52e7a-502b-4132-b40a-c8b783262746 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:15.857524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:15.858233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:15.858511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:15.858784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:15.859417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:15.860866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ad4ae-c4bb-401f-8500-da0ebbeadfb5 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:15.939728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 607/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 16:21:15 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:21:17.868888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552caffc-dd7c-457c-9f71-6bcb62cda07e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:17.869438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552caffc-dd7c-457c-9f71-6bcb62cda07e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:17.869533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552caffc-dd7c-457c-9f71-6bcb62cda07e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:17.870907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 599/1206] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:17.876096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:17.876510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:17.876650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:17.895568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:17.896814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:17.966481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 608/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:18.240136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552caffc-dd7c-457c-9f71-6bcb62cda07e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:18.341746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552caffc-dd7c-457c-9f71-6bcb62cda07e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:18.375691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:18.376325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:18.376608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:18.376885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:18.388222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:18.393134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:18.396875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:18.397908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 600/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:21:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:21:18.401156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:18.439990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:18.497252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13850147-2db4-4c01-8dcd-cd4a06f487aa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:18.530063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:18.530683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:18.530959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:18.531228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:18.531910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:18.532212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:18.533601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:18.541432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 609/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:21:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:18.547594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:18.598485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:18.645459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a84-d078-4a3b-8686-e42bfc0409f8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:18.677428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:18.679794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:18.679794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:18.679794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:18.688839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:18.690268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:18.704254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:18.705623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:18.707269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:18.707269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:18.707269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:18.707269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 601/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:18.712471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:18.812892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:18.815831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e808d2b-3882-4692-8849-7a83e66774cd None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:18.848914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:18.849517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:18.849801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:18.850077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:18.850719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:18.851025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:18.852445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:18.863533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 610/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:18.869975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:18.969290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d3ce1-a33f-4b81-93c4-db536fd87978 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:18.970856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:19.003340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.003997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.004282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.004559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.013575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.015020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:19.026383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:19.027584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:19.028726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 602/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:19.033267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:19.133913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8e57-4439-4ddd-9f11-1251df6dbef9 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:19.166968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.167604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.169038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.169038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.169038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:19.169296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.170707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.188096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 611/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:19.193904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:19.294210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b6ac-3497-431f-a29c-d8be942bb220 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:19.328745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.329350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.329625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.329893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.359086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:19.396618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.397990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.495365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 603/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:21:19.501230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:19.520016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:19.603690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a98b7-843e-4dfb-9a50-15973979c3bc None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:19.637630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.638254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.638534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.638806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.649515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.650902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:19.666239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:19.667986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:19.669147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:19.669147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:19.669147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:19.669147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 612/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:19.673140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:19.735228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:19.771921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957881c-ccfe-4972-be65-cf0bc3d4c3db None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:19.806074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.806948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.807232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.807532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.808181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:19.808488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.809861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.821827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 604/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:19.827660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:19.896875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:19.926673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30b858-6316-4993-b3e6-9ffa0781f471 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:19.959885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:19.960505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:19.961433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:19.961740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:19.968316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:19.969764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:19.980945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:19.982037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:19.983149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 613/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:19.988271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:20.088809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7cc91-0bee-4222-b4b4-01e8fab6b869 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:20.110133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:20.121280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:20.121882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:20.122161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:20.122433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:20.123122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:20.123431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:20.124879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9354a-a90e-4b42-8e58-b83154ca62c0 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:20.137076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 605/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:20.143257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:20.243400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f6ff4-981c-498c-baf7-36a2c6f24f38 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:20.271191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:20.277302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:20.277898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:20.278180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:20.278457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:20.279181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=3a7176bf626d4d8283c13da32f788c82) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:20.279512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:20.282679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ddf39-9919-4836-8496-1b064be7a828 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:20.286112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 614/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:21:20 2022] GET /identity/v3/role_assignments?user.id=3a7176bf626d4d8283c13da32f788c82&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:22.167190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d7-1c0c-4cbf-a797-ff31462a3ff3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:22.167779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d7-1c0c-4cbf-a797-ff31462a3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:22.167779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d7-1c0c-4cbf-a797-ff31462a3ff3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:22.169138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 606/1220] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:22.174223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:22.174625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:22.174769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:22.193439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:22.194604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:22.261464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 615/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:22.528750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0514d7-1c0c-4cbf-a797-ff31462a3ff3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:22.628696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0514d7-1c0c-4cbf-a797-ff31462a3ff3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:22.666828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:22.667460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:22.667777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:22.668184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:22.678408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:22.683666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:22.684747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:22.685593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 607/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:22.690786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:22.787116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9885-193e-4393-afa4-b62d4ff97751 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:22.810512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:22.820662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:22.821257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:22.821536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:22.821807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:22.822458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:22.822758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:22.824149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:22.831731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 616/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:22.838243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:22.881932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:22.938700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad01ca-c8e8-4a55-8470-6df081501aa5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:22.981649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:22.982282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:22.982559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:22.982855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:22.998825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.000288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:23.018202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:23.025180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:23.026327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:23.026327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:23.026327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:23.026327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 608/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:23.027895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.127154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007c0c-7da7-45c4-8b1b-c8942b9626fa None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.160199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.160796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.161075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.161347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.162011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:23.162313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.163852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.175084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 617/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:23.181336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.274548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:23.281099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3a91-ce13-45c0-8c16-5533eb590734 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.313950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.314580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.314861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.315133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.323201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.324682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:23.335581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:23.337345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:23.339445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 609/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:23.344286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.391803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:23.442662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb063e-a5d5-400e-aba6-807c8777477c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.476324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.477117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.477407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.477686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.478416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:23.478741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.480218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.497808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 618/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:23.503605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.603835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5a2b1-6bf0-40f7-b718-b9e88f70afcd None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.639166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.639821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.640106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.640377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.651115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.652575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:23.667228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:23.668379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:23.669665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:23.669665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:23.669665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:23.669665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 610/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:23.674264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.771533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874e2b-ba8f-40da-be45-9bdeadeb6a36 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.773941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:23.803798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.804965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.805244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.805513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.806140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:23.806707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.808138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.818768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 619/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:23.824631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:23.833886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:23.922768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2aeef-9af5-4bb7-90b3-8de2e323b083 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:23.956102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:23.962281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:23.962281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:23.962281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:23.964084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:23.965679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:23.978674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:23.979834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:23.981027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 611/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:23.986097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:24.084600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f81c-01bc-452e-861e-558f4435618e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:24.118549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:24.119151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:24.119434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:24.119733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:24.120425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:24.120739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:24.122175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f5eb5-c0fa-4d6c-ba7d-a87584b6a4d4 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:24.133970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 620/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:24.140055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:24.205151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:24.239394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce776efe-7b50-46b2-a4e5-3b0b672d606d None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:24.272642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:24.273976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:24.274254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:24.274528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/3a7176bf626d4d8283c13da32f788c82/roles/45a6ed02312a474785f158860216c19f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:24.288419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=3a7176bf626d4d8283c13da32f788c82, role_id=45a6ed02312a474785f158860216c19f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:24.290533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e74b9-2077-496d-9e3f-34a94c77b62d None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:24.431725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 612/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:21:24 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/3a7176bf626d4d8283c13da32f788c82/roles/45a6ed02312a474785f158860216c19f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:21:26.322268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd48ba-c6f2-40a4-b3ff-9edbeef6d7a9 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:26.322823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd48ba-c6f2-40a4-b3ff-9edbeef6d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:26.322823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd48ba-c6f2-40a4-b3ff-9edbeef6d7a9 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:26.324199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 621/1233] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:26.329357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:26.329773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:26.329934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:26.347781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:26.348997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:26.418345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 613/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:21:26.689338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd48ba-c6f2-40a4-b3ff-9edbeef6d7a9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:26.714129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:26.791197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd48ba-c6f2-40a4-b3ff-9edbeef6d7a9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:26.827403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:26.828063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:26.828340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:26.828610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:26.838633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:26.843296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:26.844313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:26.845263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 622/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 16:21:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:26.850376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:26.896507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:26.948265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212d1bc-4e4c-4361-895b-c42171533c41 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:26.981337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:26.981942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:26.982227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:26.982504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:26.983190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] RBAC: Adding query filter params (name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:26.983528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:26.984920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:26.993303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 614/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 16:21:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:26.999089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.083688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:27.099461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbebbde-d2e4-4dbd-967b-0036e2056901 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:27.132646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:27.133259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:27.133537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:27.133807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:27.143585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:27.145039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:27.159729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:27.160836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:27.161853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:27.161853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:27.161853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:27.161853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 623/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:27.167368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.266499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560321-5141-41d5-97f6-bf7d175fa716 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:27.276062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:27.300246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:27.300842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:27.301126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:27.301484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:27.302064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:27.302428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:27.303820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:27.315593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 615/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:27.321417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.423791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d490841-1ca3-4830-a94a-762c41213607 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:27.457951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:27.458664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:27.458943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:27.459212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:27.462483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:27.466999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:27.468907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:27.480953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:27.482107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:27.483271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 624/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:27.487959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.587645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd680-19a8-4248-8197-e90a3fd6fe2f None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:27.622637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:27.623235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:27.623539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:27.623816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:27.624544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:27.624847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:27.626266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:27.643766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 616/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:27.652085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.752337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a71b-7e6b-4f18-87a1-47e55ef88252 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:27.786089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:27.786689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:27.787001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:27.787278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:27.848019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:27.854619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:27.856102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:27.954906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 625/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:21:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:21:27.961094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:27.989105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:28.063246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aeb2be-cdde-4179-b525-f336deedc9cb None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:28.097039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:28.097660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:28.097940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:28.098260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:28.108882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:28.110315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:28.125224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:28.126205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:28.127165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:28.127165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:28.127165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:28.127165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 617/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:28.132083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:28.223149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:28.229555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb031c-3f25-42c3-a063-0e585d5d269e None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:28.261931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:28.262525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:28.262801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:28.263071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:28.263770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:28.264074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:28.265437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:28.276193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 626/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:28.281878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:28.364528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:28.387466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7004e7-7526-4102-872b-4580f327d634 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:28.421663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:28.422284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:28.422566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:28.422839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:28.430610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:28.432831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:28.444130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:28.446480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:28.447625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 618/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:28.451719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:28.551883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1ea38-cd3e-4bd8-a3e0-29d51c20fa71 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:28.584703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:28.585844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:28.586143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:28.586417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:28.587104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:28.587455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:28.588924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a964-42b2-4a43-8343-f497e5d59a73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:28.601653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 627/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:28.608145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:28.709194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e930f-ea2d-4cc7-9fc5-c7c587ada768 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:28.744017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:28.744622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:28.744905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:28.745181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:28.745907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] RBAC: Adding query filter params (role.id=45a6ed02312a474785f158860216c19f, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=3a7176bf626d4d8283c13da32f788c82) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:28.746248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:28.747803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f379-2346-45de-91e9-320a81456953 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:28.753517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 619/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:21:28 2022] GET /identity/v3/role_assignments?user.id=3a7176bf626d4d8283c13da32f788c82&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=45a6ed02312a474785f158860216c19f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:30.716176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0611f9-80da-457d-8760-2dcf7c68edba None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:30.716698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0611f9-80da-457d-8760-2dcf7c68edba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:30.716698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0611f9-80da-457d-8760-2dcf7c68edba None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:30.718006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 628/1247] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:30.723024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:30.723440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:30.723623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:30.733396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:30.745933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:30.747115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:30.814140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 620/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 16:21:31.086202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0611f9-80da-457d-8760-2dcf7c68edba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.104558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:31.185059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0611f9-80da-457d-8760-2dcf7c68edba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:31.217890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:31.218504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:31.218784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:31.219055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:31.229310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:31.233954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:31.235912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:31.236963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 629/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:31.241258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.339623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7bb35-aac3-4e39-a722-4aceebd16553 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:31.369919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:31.374768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:31.375379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:31.375685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:31.375963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:31.376632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:31.376939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:31.378333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:31.386214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 621/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:31.392247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.471050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:31.494608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262b09-522b-4b56-9707-1e049172fc60 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:31.527209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:31.527858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:31.528141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:31.528416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:31.539392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:31.548294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:31.555177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:31.556569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:31.557489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:31.557489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:31.557489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:31.557489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 630/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:31.562619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.662752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649e63-e0b9-4e4a-9e58-507d56eff409 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:31.697333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:31.698087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:31.698269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:31.698543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:31.699186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:31.699509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:31.700885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:31.712932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 622/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:31.718650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.817192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c46f2-02f8-4d18-9d51-683c210c1832 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:31.842701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:31.850205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:31.851418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:31.851727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:31.851994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:31.859092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:31.860559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:31.871716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:31.872731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:31.874124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 631/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:31.878758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:31.934053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:31.978204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477be947-90af-4cb3-b058-14d2c8cc6434 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.012757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.013360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.013637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.013907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.014634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:32.014933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.016400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.035145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 623/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:21:32.041300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:32.140938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed70b-5074-4227-9671-2861d5dd0b81 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.174082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.174689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.174968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.175274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.229154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:32.240601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.242727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.335776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 632/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:21:32.341606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:32.442066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304e195-95f2-4ad0-80d2-55b7a1128f3e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.455599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:32.476198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.476825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.477106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.477381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.489846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.489846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:32.503142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:32.504292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:32.505447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:32.505447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:32.505447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:32.505447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 624/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:32.510788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:32.597936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:32.610436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12f71-00f1-4095-971c-3e77a68110c7 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.645025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.645679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.645964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.646245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.646883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:32.647183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.648788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.659776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 633/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:32.666236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:32.765588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d532fa-8a4f-4f29-8f2e-e9eda175798a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.798024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.798667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.798948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.799234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.806819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.808309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:32.819287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:32.820351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:32.821500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 625/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:32.826531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:32.923999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac9cb-7721-497f-b463-886401502fe3 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:32.956948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:32.957550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:32.957832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:32.958176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:32.958867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:32.959176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:32.960676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212510f-bdf1-491c-b81b-2d80b9db36d1 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:32.972789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 634/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:32.979411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:33.011158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:33.086551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc474-4ebf-4364-9c59-dd6e33daf3c6 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:33.120217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:33.120824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:33.121104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:33.121377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:33.122099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=3a7176bf626d4d8283c13da32f788c82) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:33.122408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:33.123855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833afc63-1749-4cf2-a376-d272020397f7 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:33.129229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 626/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:21:32 2022] GET /identity/v3/role_assignments?user.id=3a7176bf626d4d8283c13da32f788c82&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:35.045315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b99b-4d7b-430b-84a6-d9c10b48836d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:35.045840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b99b-4d7b-430b-84a6-d9c10b48836d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:35.045931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b99b-4d7b-430b-84a6-d9c10b48836d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:35.047263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 635/1261] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:35.052487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:35.052904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:35.053040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:35.072318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:35.074160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:35.139282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 627/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:35.413363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b99b-4d7b-430b-84a6-d9c10b48836d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:35.424324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:35.515775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b99b-4d7b-430b-84a6-d9c10b48836d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:35.548767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:35.549395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:35.549680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:35.549957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:35.561189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:35.565985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:35.567073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:35.568075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 636/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:35.574005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:35.592310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:35.670751 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3112b5-3d12-4d08-af16-ff10672515a3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:35.704261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:35.704856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:35.705135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:35.705405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:35.706058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:35.706358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:35.707738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:35.716433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 628/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:35.722222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:35.789926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:35.823677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674b81-4428-4b4a-802c-7d49c086435c None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:35.856228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:35.856854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:35.857138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:35.857417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:35.868331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:35.869808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:35.884398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:35.891941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:35.893025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:35.893025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:35.893025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:35.893025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 637/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:35.893314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:35.971648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:35.990513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f560dc4-fe57-4d43-8f85-10253ba7344a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.022390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.023554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.023841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.024117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.024754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:36.025060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.026430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.039239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 629/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:36.044896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.144701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705e92-47a2-4946-a06b-71cdad06ae55 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.165138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:36.178746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.179549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.179875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.180154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.187653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.189688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:36.199957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:36.201057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:36.202062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 638/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:36.207015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.306456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0655b-ad9f-4b26-97cc-560062295401 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.340939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.341540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.341823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.342098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.342825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:36.343131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.344645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.355588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:36.363056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 630/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:36.368895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.466929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b10b1b-8894-4672-afb5-718a0ff8c3b6 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.498854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.499470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.499777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.500047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.510589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.512073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:36.526014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:36.530494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:36.531666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:36.531666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:36.531666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:36.531666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 639/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:36.533032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.634878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f9b3-92aa-40a8-ac6f-9ce57a82f0f4 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.668661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.669270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.669553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.669828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.670469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:36.670832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.672291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.683715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 631/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:36.689630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.722655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:36.790630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655feb-2939-48b4-994b-f42d7ff8c1c0 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.824784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.825401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.825687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.825963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.832400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.833846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:36.845283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:36.846360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:36.847472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 640/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:36.853003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:36.911568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:36.953203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e284c-99e1-4a5a-af42-682a5121145a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:36.985663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:36.986297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:36.986574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:36.986844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:36.987555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:36.987859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:36.989271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d83467-0097-4e6a-85ad-e4ca19aa955c None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:37.001108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 632/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:37.007822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:37.099384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:37.108747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529d85-3940-43e0-8e26-5ad8bb89725b None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:37.142058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:37.142732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:37.143016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:37.143290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] PATH_INFO: `/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/3a7176bf626d4d8283c13da32f788c82/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:37.145253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0d36cf34b24e869bf86aff69c48d30, user_id=3a7176bf626d4d8283c13da32f788c82, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:37.146733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35144ad2-6a07-40e8-968e-18f305955f43 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:37.300296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 641/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 16:21:37 2022] PUT /identity/v3/projects/6d0d36cf34b24e869bf86aff69c48d30/users/3a7176bf626d4d8283c13da32f788c82/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:21:39.174836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a668b9-8cc6-47bb-8b5a-f55ed48d5487 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:39.175510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a668b9-8cc6-47bb-8b5a-f55ed48d5487 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:39.175510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a668b9-8cc6-47bb-8b5a-f55ed48d5487 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:39.176826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 633/1274] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:39.182867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:39.183325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:39.183468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:39.201928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:39.203128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:39.268706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 642/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:39.541711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a668b9-8cc6-47bb-8b5a-f55ed48d5487 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:39.644420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a668b9-8cc6-47bb-8b5a-f55ed48d5487 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:39.661513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:39.679309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:39.680150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:39.680431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:39.680758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:39.691063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 16:21:39.696067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:39.697650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:39.698671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 634/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 16:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:39.703579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:39.784465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:39.805786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00096db0-912f-4a4a-a878-45c94680c08a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:39.837490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:39.838100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:39.838384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:39.838661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:39.839330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:39.839733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:39.841116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:39.848994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 643/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 16:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:39.854916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:39.953287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18653b-d019-4e94-8a8d-514ec6e3836e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:39.986492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:39.987117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:39.987399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:39.987705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:39.998135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:39.999620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:40.015525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:40.016619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:40.017597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:40.017597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:40.017597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:40.017597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 635/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:21:40.022723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:40.123666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db02a8-dd69-4458-baa5-a01d2bdf376f None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:40.156431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:40.157028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:40.157308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:40.157585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:40.158277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:40.158575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:40.159991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.171896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 644/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:40.177549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:40.208756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:40.277434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc9d9-f95c-4663-9e9b-ff9048189ef8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:40.313035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:40.313655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:40.313929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:40.314197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:40.321438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:40.322866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 16:21:40.333507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:40.334760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:40.335992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 636/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:40.341040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:40.344779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:40.442809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c7fe-e3ea-4fe5-aff2-2ff2c423bf73 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:40.477649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:40.478326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:40.478659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:40.478937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:40.479781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:40.480123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:40.481639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.499089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 645/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:40.505154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:40.595899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:40.605390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264e46-40e2-4292-883f-9afdfb2670a8 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:40.637840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:40.638445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:40.638725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:40.638998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:40.708114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:40.709482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.798044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:40.809180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 637/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 16:21:40.814985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:40.876201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:40.915935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ccef0-7e37-4ac5-8ec2-1f2bcca8fe58 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:40.950274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:40.950900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:40.951177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:40.951443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:40.961806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:40.963202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 16:21:40.977311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:40.979248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 16:21:40.980411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 16:21:40.980411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 16:21:40.980411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:40.980411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 646/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:40.984283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:41.080537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eeab1-3f8c-410d-a281-53d16a6ce49a None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:41.113938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:41.114536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:41.114847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:41.115114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:41.115779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:41.116084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:41.118525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:41.129714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 638/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:41.135720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:41.236188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007121d-375d-41c4-9c99-1d47c3174295 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:41.250285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:41.269593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:41.270209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:41.270489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:41.270759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:41.278713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:41.280259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 16:21:41.291881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:41.292986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: ERROR keystone.server.flask.application Aug 19 16:21:41.293935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 647/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 16:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:41.298771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:41.348333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:41.398505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da5cf-17f4-494c-9fce-e048ffe4f796 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:41.431233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:41.431863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:41.432145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:41.432420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:41.433106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:41.433414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:41.434846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17378-e102-4407-a887-1f70ce72d953 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:41.447280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 639/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 16:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:41.452533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:41.556317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c530-887e-4581-923e-f1c35a21f207 None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:41.589240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:41.589836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:41.590114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:41.590388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:41.591113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] RBAC: Adding query filter params (role.id=80a461100b904c7e8f047066bc70bf3b, scope.project.id=6d0d36cf34b24e869bf86aff69c48d30, user.id=3a7176bf626d4d8283c13da32f788c82) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:41.591419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:41.592870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7162c6-b411-40b8-8c35-e248e32bedc7 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:41.598440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 648/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 16:21:41 2022] GET /identity/v3/role_assignments?user.id=3a7176bf626d4d8283c13da32f788c82&scope.project.id=6d0d36cf34b24e869bf86aff69c48d30&role.id=80a461100b904c7e8f047066bc70bf3b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:43.494626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc732d9-e087-4850-9ca6-2fe54aa7ef38 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:43.495135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc732d9-e087-4850-9ca6-2fe54aa7ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:43.495225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc732d9-e087-4850-9ca6-2fe54aa7ef38 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:43.496560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 640/1288] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:43.501524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:43.501899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:43.502079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:43.520050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:43.521279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:43.551121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:43.588173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 649/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:43.856539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc732d9-e087-4850-9ca6-2fe54aa7ef38 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:43.955457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc732d9-e087-4850-9ca6-2fe54aa7ef38 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:43.966108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:43.989797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:43.990442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:43.990719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:43.991060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:43.992159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:43.993514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:44.001920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:44.003142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:44.004315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 641/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:21:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:44.009455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:44.108185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89848-a344-4864-88cd-613333b33da9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:44.143902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:44.144500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:44.144779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:44.145050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:44.145673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:44.145975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:44.147578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65a7b8-5666-412b-8a56-84bf99158f18 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:44.152674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 650/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 16:21:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:44.158464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:44.258697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef2c71-61d4-4947-9f98-762ae558b31e None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:44.294451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:44.295077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:44.295352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:44.295656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] PATH_INFO: `/v3/services` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:44.296278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:44.296574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:44.297962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f5e83-d9c2-4ad6-919a-feb6299c356a None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:44.302328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 642/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 16:21:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:46.224081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababe3b-a464-4d2e-b9bc-1b0962fda679 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:46.224610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababe3b-a464-4d2e-b9bc-1b0962fda679 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:46.224610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababe3b-a464-4d2e-b9bc-1b0962fda679 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:46.226508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 651/1293] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:46.231621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6adc-a00f-4760-9938-b5cca39029b3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:46.232043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6adc-a00f-4760-9938-b5cca39029b3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:46.232190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba6adc-a00f-4760-9938-b5cca39029b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:46.250657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-80ba6adc-a00f-4760-9938-b5cca39029b3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:46.251891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80ba6adc-a00f-4760-9938-b5cca39029b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:46.285866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:46.322718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 643/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:46.591982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababe3b-a464-4d2e-b9bc-1b0962fda679 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:46.622807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:46.691088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababe3b-a464-4d2e-b9bc-1b0962fda679 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:46.725086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:46.726614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:46.726892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:46.727204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:46.727831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:46.729187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b08dd-1ca9-455e-b2f5-7db7abcf1d2f None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:46.824738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 652/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 16:21:46 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:21:48.731129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d7a1-2de7-4690-b2d3-d47fecf687dc None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:48.731677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d7a1-2de7-4690-b2d3-d47fecf687dc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:48.731677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d7a1-2de7-4690-b2d3-d47fecf687dc None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:48.732996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 644/1296] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:48.738184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:48.738563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:48.738757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:48.757332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:48.758518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:48.830186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 653/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:49.103582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d7a1-2de7-4690-b2d3-d47fecf687dc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:49.203801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d7a1-2de7-4690-b2d3-d47fecf687dc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:49.237642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:49.238259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:49.238541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:49.238816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:49.239399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:49.241918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:49.250384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:49.251595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:49.252512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 645/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:21:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 16:21:49.259523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:49.277383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:49.357341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583068-33d3-4f3d-8aa5-42273d374ae0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:49.390734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:49.391340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:49.391660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:49.391937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:49.392566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:49.392872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:49.394268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:49.399324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 654/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 16:21:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:49.405413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:49.437977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:49.506075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abadac-d337-4a03-8c29-30e28efb0457 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:49.540835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:49.541438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:49.541718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:49.541992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:49.542691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] RBAC: Adding query filter params (interface=public, service_id=993a343c0c7541ca99b37fd48680410b, region_id=RegionOne) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:49.543018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:49.544501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12a4f5-fe19-487b-b8fb-fe957f9ce19b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:49.549381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 646/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 16:21:49 2022] GET /identity/v3/endpoints?service_id=993a343c0c7541ca99b37fd48680410b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:49.555892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:49.642337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:49.660815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cccd7-27aa-498f-8961-0e978df625be None admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:49.696027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:49.696630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:49.696913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:49.697190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:49.697796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:49.699185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87db1d-07fb-4bf5-aa38-c93b2d778598 None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:49.706162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 655/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 16:21:49 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:21:51.584296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbf84-8923-4310-8c8d-64eec6d50fdf None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:51.585638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbf84-8923-4310-8c8d-64eec6d50fdf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:51.585811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbf84-8923-4310-8c8d-64eec6d50fdf None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:51.587211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 647/1302] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:21:51.592427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:51.592823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:51.592975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:51.611209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:21:51.612358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:21:51.679682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 656/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:21:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 16:21:51.947934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbf84-8923-4310-8c8d-64eec6d50fdf None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:52.042320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:52.048784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbf84-8923-4310-8c8d-64eec6d50fdf None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:52.082372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:52.082994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:52.083273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:52.083571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:52.084153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:52.086243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 16:21:52.094752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 16:21:52.095792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application with Lock( Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self._enter() Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application return self.creator() Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application created_value = creator( Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: ERROR keystone.server.flask.application Aug 19 16:21:52.096633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 648/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 16:21:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 16:21:52.102880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:52.177846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:21:52.200536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04ef1-3c55-4444-8674-21434b6031e4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:52.235071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:52.235708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:52.235985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:52.236268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] PATH_INFO: `/v3/services` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:52.236899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:21:52.237208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:52.238599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8b33-4700-4a42-8317-e343eab74c9b None admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:52.243836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 657/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 16:21:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:21:52.249524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:21:52.350187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190db97-1a24-4a3e-8923-ba4ea79ccca5 None admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:21:52.384194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:21:52.384799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:21:52.385080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:21:52.385356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:21:52.386020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:21:52.387396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad201-0ba4-412a-bd3d-ac0bf060434b None admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:21:52.516933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 649/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:21:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:22:02.240674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=30 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:22:02.512318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:16.261079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d2da-2345-46aa-bc4e-7db2a0de52fd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:16.262669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d2da-2345-46aa-bc4e-7db2a0de52fd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:16.263178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d2da-2345-46aa-bc4e-7db2a0de52fd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:16.270156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6fdd-d2f4-417d-925e-121857d041ca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:16.271099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6fdd-d2f4-417d-925e-121857d041ca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:16.271641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6fdd-d2f4-417d-925e-121857d041ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:16.275828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 658/1307] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:16 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:16.365709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-550e6fdd-d2f4-417d-925e-121857d041ca None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:16.367151 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-550e6fdd-d2f4-417d-925e-121857d041ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:16.496909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 650/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:28:16.801529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:16.801831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:16.802104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:16.813646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 659/1309] 10.222.0.43 () {54 vars in 965 bytes} [Fri Aug 19 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:28:16.813760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0823d4-b03b-47c9-b4bc-1d4dede0cb9c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:16.813760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0823d4-b03b-47c9-b4bc-1d4dede0cb9c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:16.813760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0823d4-b03b-47c9-b4bc-1d4dede0cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:16.895827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cf0823d4-b03b-47c9-b4bc-1d4dede0cb9c None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:16.897854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cf0823d4-b03b-47c9-b4bc-1d4dede0cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:16.920560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:16.978575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 651/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Fri Aug 19 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:28:16.988698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:16.990530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:17.112872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba023519-d59b-4197-b9aa-1a06a20d182b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:17.202704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:17.203331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:17.203645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:17.203924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:17.205627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:17.265831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:17.324374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:17.325828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ba7d0-b50e-44a0-813f-a96d4a6233b4 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:17.346437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 660/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:19.573219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:19.573746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:19.573746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:19.575372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 652/1312] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:19.580893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f493-0597-408c-89c4-6a146f422b15 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:19.581770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f493-0597-408c-89c4-6a146f422b15 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:19.581770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f493-0597-408c-89c4-6a146f422b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:19.664871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4051f493-0597-408c-89c4-6a146f422b15 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:19.666158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4051f493-0597-408c-89c4-6a146f422b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:19.786671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 661/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:20.068548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:20.070128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:20.174558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21411df-90ba-4f8a-b37e-5f6cc9d11c21 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:20.247709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:20.250445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:20.251057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:20.251339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:20.251642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:20.253264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:20.366486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:20.367969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76246-0d63-430d-9c3f-ff0faf92e522 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:20.386546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 653/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:22.731742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:22.732309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:22.732309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:22.733554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 662/1315] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:22.738614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592ddf-9d4d-4d8b-baa4-22890603321c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:22.739010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592ddf-9d4d-4d8b-baa4-22890603321c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:22.739160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592ddf-9d4d-4d8b-baa4-22890603321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:22.805780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f592ddf-9d4d-4d8b-baa4-22890603321c None None] MFA Rules not processed for user `382ba35c370742fcb658244cd3f22466`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:22.806996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f592ddf-9d4d-4d8b-baa4-22890603321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:22.857822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:22.901394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 654/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:23.185176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:23.187048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:23.196676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:23.290149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d579-0b70-43e6-8d5b-38bed742c284 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:23.363219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:23.363873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:23.364155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:23.364430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:23.366037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:23.431043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:23.476164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:23.477616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2beb9c-74cb-4374-8137-0012a8d7ed44 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:23.496338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 663/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:26.294241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b77d-aa75-450d-8539-fca49ced47d5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:26.295015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b77d-aa75-450d-8539-fca49ced47d5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:26.295015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b77d-aa75-450d-8539-fca49ced47d5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:26.296365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 655/1318] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:26.301685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c645-40c2-4950-9987-f630ab950f11 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:26.302075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c645-40c2-4950-9987-f630ab950f11 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:26.302250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c645-40c2-4950-9987-f630ab950f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:26.368765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d0c6c645-40c2-4950-9987-f630ab950f11 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:26.369994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d0c6c645-40c2-4950-9987-f630ab950f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:26.468400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 664/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:26.773761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:26.774047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:26.774327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:26.775713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 656/1320] 10.222.0.43 () {54 vars in 965 bytes} [Fri Aug 19 16:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:26.782527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28f9e-5800-45bb-9e89-6c6e3ba9e2b7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:26.782821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28f9e-5800-45bb-9e89-6c6e3ba9e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:26.783100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28f9e-5800-45bb-9e89-6c6e3ba9e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:26.806359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:26.867734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-48f28f9e-5800-45bb-9e89-6c6e3ba9e2b7 None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:26.868934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-48f28f9e-5800-45bb-9e89-6c6e3ba9e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:26.942300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 665/1321] 10.222.0.43 () {58 vars in 1062 bytes} [Fri Aug 19 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:26.951921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:26.953456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:27.055926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d6da1-966e-4335-8f7a-d471d7fce0b8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:27.132211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:27.132809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:27.133091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:27.133369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:27.134990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:27.143224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:27.242430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:27.243894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fe5d5-4b3b-4b6d-9b5c-dafade1564e7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:27.262785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 657/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:30.612010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:30.612538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:30.612538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:30.613916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 666/1323] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:30.619104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4283b-3094-4fee-83e4-8b06e8f667d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:30.619524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4283b-3094-4fee-83e4-8b06e8f667d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:30.619685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4283b-3094-4fee-83e4-8b06e8f667d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:30.686741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6d4283b-3094-4fee-83e4-8b06e8f667d4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:30.687976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6d4283b-3094-4fee-83e4-8b06e8f667d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:30.745874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:30.787251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 658/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:31.072364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:31.074479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:31.176560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be353-9e84-4d7f-a42f-bb04b4cd3675 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:31.188561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:31.249581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:31.250186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:31.250465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:31.250738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:31.252367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:31.360996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:31.362463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c576ba6-e1fb-4ac1-8fa2-55265c8fce52 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:31.381709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 667/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:33.372484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:33.372957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:33.373061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:33.374388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 659/1326] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:33.379718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858496ba-1902-4528-a8da-57bae11475cf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:33.380130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858496ba-1902-4528-a8da-57bae11475cf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:33.380279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858496ba-1902-4528-a8da-57bae11475cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:33.430398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:33.450046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-858496ba-1902-4528-a8da-57bae11475cf None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:33.452719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-858496ba-1902-4528-a8da-57bae11475cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:33.546239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 668/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:33.843364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:33.844939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:33.950184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4a05-95ce-4682-b581-2ad64993cf7e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:34.036102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:34.036721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:34.037002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:34.037277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:34.038882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:34.057135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:34.149739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:34.151257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fece58-54db-4b98-8d7c-4f07c65c12b6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:34.171207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 660/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:36.203942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:36.204566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:36.204566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:36.205852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 669/1329] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:36.211722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b69fb-a646-4807-ae14-052fc2753994 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:36.212281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b69fb-a646-4807-ae14-052fc2753994 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:36.212281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b69fb-a646-4807-ae14-052fc2753994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:36.278701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c99b69fb-a646-4807-ae14-052fc2753994 None None] MFA Rules not processed for user `382ba35c370742fcb658244cd3f22466`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:36.279929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c99b69fb-a646-4807-ae14-052fc2753994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:36.344946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:36.380346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 661/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:36.670310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:36.671893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:36.778638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262b1e-3d8c-4914-8998-58bff86ba447 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:36.798196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:36.852337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:36.852881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:36.853160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:36.853435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:36.855449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:36.963764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:36.965248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a9d8-8cbc-4813-8d58-77b9e6f401fe service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:36.983273 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 670/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:39.438754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:39.439311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:39.439311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:39.440880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 662/1332] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:39.447729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794699e4-5565-42bf-a24b-bcd1acea0a11 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:39.448196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794699e4-5565-42bf-a24b-bcd1acea0a11 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:39.448299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794699e4-5565-42bf-a24b-bcd1acea0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:39.515627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:39.519658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-794699e4-5565-42bf-a24b-bcd1acea0a11 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:39.520876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-794699e4-5565-42bf-a24b-bcd1acea0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:39.624182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 671/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:39.924159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:39.925934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:40.037720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02577f1d-d695-46fa-888b-02dfdccd2277 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:40.112917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:40.113525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:40.113805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:40.114077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:40.115702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:40.142683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:40.224073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:40.225410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31de1-7d61-4a1d-9d4e-fea270f094ea service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:40.243836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 663/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:42.210498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:42.211025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:42.211025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:42.212363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 672/1335] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:42.218212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb87c7-a972-4dc6-98c3-ece356082346 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:42.218618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb87c7-a972-4dc6-98c3-ece356082346 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:42.218759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb87c7-a972-4dc6-98c3-ece356082346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:42.284124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-77eb87c7-a972-4dc6-98c3-ece356082346 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:42.285311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77eb87c7-a972-4dc6-98c3-ece356082346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:42.359684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:42.381959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 664/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:42.667383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:42.669398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:42.771667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46538-74de-4cc3-bd4d-7a9a03c5b7fd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:42.798981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:42.843997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:42.844605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:42.844886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:42.845167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:42.846749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:42.955813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:42.957175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039ccef-bc63-4d5e-8ce1-cab2a7691573 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:42.976435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 673/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:45.490165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:45.497693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:45.497693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:45.497693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 665/1338] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:45.497969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a4ef-d5b4-42ac-b4fb-28eec28f645d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:45.497969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a4ef-d5b4-42ac-b4fb-28eec28f645d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:45.497969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a4ef-d5b4-42ac-b4fb-28eec28f645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:45.565323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-23e1a4ef-d5b4-42ac-b4fb-28eec28f645d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:45.566606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-23e1a4ef-d5b4-42ac-b4fb-28eec28f645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:45.575702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:45.666541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 674/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:45.950901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:45.952467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:46.055376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f22db-a276-4296-8f16-9a1cfb35ce83 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:46.126494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:46.127100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:46.127382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:46.127685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:46.129294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:46.164098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:46.237789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:46.239142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59692d2d-1d9a-4ef4-8437-1c7a870262a2 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:46.257860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 666/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:50.412304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:50.412824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:50.412939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:50.414279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 675/1341] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:50.420186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282fa4-2795-4ca1-8b00-59119615f8f1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:50.420607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282fa4-2795-4ca1-8b00-59119615f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:50.420736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282fa4-2795-4ca1-8b00-59119615f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:50.488739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b8282fa4-2795-4ca1-8b00-59119615f8f1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:50.490050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8282fa4-2795-4ca1-8b00-59119615f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:50.579945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:50.591933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 667/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:50.878749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:50.880346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:50.987911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848d0e-3f1f-4ab7-9337-406153ef7c9c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:51.026748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:51.063792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:51.064435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:51.064986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:51.065507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:51.067470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:51.178895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:51.180339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07040b48-6bb8-4e03-a1cc-697bdea977eb service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:51.199909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 676/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:54.097722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:54.098233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:54.098233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:54.099553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 668/1344] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:54.104808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632b0-5be6-4cca-b1c6-41f4d4a745e8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:54.105248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632b0-5be6-4cca-b1c6-41f4d4a745e8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:54.106537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3632b0-5be6-4cca-b1c6-41f4d4a745e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:54.172310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8e3632b0-5be6-4cca-b1c6-41f4d4a745e8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:54.173501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8e3632b0-5be6-4cca-b1c6-41f4d4a745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:54.191196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:54.271279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 677/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:54.557189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:54.559336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:54.666989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce1386-37fe-415d-b655-c918a7e3c6c3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:54.755164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:54.755819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:54.756106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:54.756387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:54.758009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:54.803608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:54.876270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:28:54.877702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e528d3-de37-4cf1-90fc-631c6776d898 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:28:54.896366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 669/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:28:59.219096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:59.219638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:59.219750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:59.221198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 678/1347] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:28:59.226362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4fe6-9bfc-45ee-81c2-66a0019cd4cd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:59.226763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4fe6-9bfc-45ee-81c2-66a0019cd4cd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:59.226915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4fe6-9bfc-45ee-81c2-66a0019cd4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:59.300258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0f5d4fe6-9bfc-45ee-81c2-66a0019cd4cd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:28:59.301403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0f5d4fe6-9bfc-45ee-81c2-66a0019cd4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:59.403819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:59.407663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 670/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:28:59.688682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:28:59.690205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:28:59.804444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce504-b8b5-4021-8f2b-54ffc7762764 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:28:59.854446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:28:59.887077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:28:59.888452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:28:59.888738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:28:59.889014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:28:59.890695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:00.005285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:00.006736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac58a15-1092-4500-bc38-846d28ae2bd6 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:00.025752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 679/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:04.895317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d23f-7c4b-44ca-ade9-cabe30de0caa None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:04.895870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d23f-7c4b-44ca-ade9-cabe30de0caa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:04.895961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d23f-7c4b-44ca-ade9-cabe30de0caa None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:04.897507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 671/1350] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:04.903090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0514b-8853-48db-82fc-3db9b1675fbe None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:04.903533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0514b-8853-48db-82fc-3db9b1675fbe None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:04.903743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0514b-8853-48db-82fc-3db9b1675fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:05.005809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20a0514b-8853-48db-82fc-3db9b1675fbe None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:05.007225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20a0514b-8853-48db-82fc-3db9b1675fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:05.028453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:05.295543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 680/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:09.437805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5255-d8b5-430d-bb40-a9d94f96b642 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:09.438875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5255-d8b5-430d-bb40-a9d94f96b642 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:09.439226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5255-d8b5-430d-bb40-a9d94f96b642 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:09.440909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 672/1352] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:09.445823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2579-9506-4e15-996e-34e033415446 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:09.446230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2579-9506-4e15-996e-34e033415446 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:09.446507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf2579-9506-4e15-996e-34e033415446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:09.525217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-03cf2579-9506-4e15-996e-34e033415446 None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:09.526531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03cf2579-9506-4e15-996e-34e033415446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:09.604438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:09.645627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 681/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:10.991998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9df9-4b59-4bd1-822d-6efb0dca935d None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:10.992577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9df9-4b59-4bd1-822d-6efb0dca935d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:10.992577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9df9-4b59-4bd1-822d-6efb0dca935d None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:10.993879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 673/1354] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:10.999796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b270e-204d-494a-b9dd-e896db4acc2f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:11.000266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b270e-204d-494a-b9dd-e896db4acc2f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:11.000362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b270e-204d-494a-b9dd-e896db4acc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:11.077625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4a9b270e-204d-494a-b9dd-e896db4acc2f None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:11.078854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4a9b270e-204d-494a-b9dd-e896db4acc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:11.192399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 682/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:14.549659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35999d-52f9-4bb1-8bec-beda94c3ef87 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:14.550198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35999d-52f9-4bb1-8bec-beda94c3ef87 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:14.550198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35999d-52f9-4bb1-8bec-beda94c3ef87 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:14.551625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 674/1356] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:14.557276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de13ab-7055-4200-b92e-2edabb902419 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:14.557699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de13ab-7055-4200-b92e-2edabb902419 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:14.558449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de13ab-7055-4200-b92e-2edabb902419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:14.607866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:14.642120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e6de13ab-7055-4200-b92e-2edabb902419 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:14.643619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6de13ab-7055-4200-b92e-2edabb902419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:14.783685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 683/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:15.087037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:15.087831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:15.088509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:15.091342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 675/1358] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 16:29:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:29:15.100617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737281-489f-4d8b-b928-fad75d51ccf3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:15.110965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737281-489f-4d8b-b928-fad75d51ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:15.110965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737281-489f-4d8b-b928-fad75d51ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:15.185696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ee737281-489f-4d8b-b928-fad75d51ccf3 None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:15.187140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee737281-489f-4d8b-b928-fad75d51ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:15.240063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:15.311194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 684/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:29:15.319464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:15.321256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:15.482120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde1f6-8bc4-46df-8ac8-495ef6fc8a7f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:15.562984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:15.605182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:15.605928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:15.606262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:15.606533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:15.608387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:15.705986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:15.707687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9363fc-95b8-489b-9996-1e08bbe86fe5 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:15.727518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 676/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:17.879541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:17.880032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:17.880032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:17.881525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 685/1361] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:29:17.886652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b61af-de22-42d5-9cc3-b0285443e96d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:17.887058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b61af-de22-42d5-9cc3-b0285443e96d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:17.887211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b61af-de22-42d5-9cc3-b0285443e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:17.958993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ef1b61af-de22-42d5-9cc3-b0285443e96d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:17.960241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef1b61af-de22-42d5-9cc3-b0285443e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:18.004654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:18.073394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 677/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:18.370036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:18.370036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:18.560649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fcc84-7c51-46aa-ae84-55483c711714 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:18.571472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:18.689926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:18.690556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:18.691005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:18.691452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:18.693289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:18.802792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:18.804678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fb0b1-b4e6-47cf-bbb1-914a6e14aea9 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:18.827459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 686/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:21.181180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51500-a373-44ac-83d0-0510fd825115 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:21.181717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51500-a373-44ac-83d0-0510fd825115 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:21.181935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51500-a373-44ac-83d0-0510fd825115 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:21.183617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 678/1364] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:21.190662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054ea9-226b-417f-a9fe-9d6e3e898e1e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:21.190662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054ea9-226b-417f-a9fe-9d6e3e898e1e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:21.190662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5054ea9-226b-417f-a9fe-9d6e3e898e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:21.209696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:21.269278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e5054ea9-226b-417f-a9fe-9d6e3e898e1e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:21.270487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e5054ea9-226b-417f-a9fe-9d6e3e898e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:21.379583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 687/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:21.674659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:21.675197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:21.679642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:21.679642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 679/1366] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 16:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:21.685542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84eb1e6-5d9f-49f6-9cca-677e308b9826 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:21.686033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84eb1e6-5d9f-49f6-9cca-677e308b9826 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:21.686455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84eb1e6-5d9f-49f6-9cca-677e308b9826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:21.779112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a84eb1e6-5d9f-49f6-9cca-677e308b9826 None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:21.780370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a84eb1e6-5d9f-49f6-9cca-677e308b9826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:21.818092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:21.915652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 688/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:29:21.918592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:21.920475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:22.084221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5f57e-656c-46a9-aeac-64b284bbd274 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:22.107147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:22.211903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:22.212536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:22.212783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:22.212955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:22.215741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:22.311308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:22.313154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a0404-c0e3-4f1a-86d7-50f649042108 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:22.335247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 680/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:22.951276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a8e4-f190-42cf-8718-2e53eb424f01 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:22.951843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a8e4-f190-42cf-8718-2e53eb424f01 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:22.951843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a8e4-f190-42cf-8718-2e53eb424f01 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:22.953364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 689/1369] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:22.959863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67eb2-3ac2-43e0-b416-87faf7575b21 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:22.960602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67eb2-3ac2-43e0-b416-87faf7575b21 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:22.960984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67eb2-3ac2-43e0-b416-87faf7575b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:22.996763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:23.037122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7bd67eb2-3ac2-43e0-b416-87faf7575b21 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:23.038350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7bd67eb2-3ac2-43e0-b416-87faf7575b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:23.142170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 681/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:23.737392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:23.737794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:23.738484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:23.739628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 690/1371] 10.222.0.43 () {54 vars in 964 bytes} [Fri Aug 19 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:23.744367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f427-0b60-4768-99e7-f35fe7a91272 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:23.744831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f427-0b60-4768-99e7-f35fe7a91272 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:23.745069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64f427-0b60-4768-99e7-f35fe7a91272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:23.825583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d64f427-0b60-4768-99e7-f35fe7a91272 None None] MFA Rules not processed for user `7ecf96598f034c928195d02f98059469`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:23.826855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d64f427-0b60-4768-99e7-f35fe7a91272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:23.875243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:23.907019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 682/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Aug 19 16:29:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:23.914924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:23.916819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:24.029194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433410d-8b76-4a7e-8e46-cae73997bec8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:24.072936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:24.115202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:24.116066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:24.116426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:24.116772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:24.118463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:24.247914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:24.249320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b0b4f-c453-4599-a2ec-c9ec550e73a1 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:24.272307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 691/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:24.519932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:24.520226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:24.520509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:24.521878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 683/1374] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:24.527257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4cdd9-a793-4810-b358-421715feed68 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:24.527627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4cdd9-a793-4810-b358-421715feed68 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:24.527938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4cdd9-a793-4810-b358-421715feed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:24.612637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e9f4cdd9-a793-4810-b358-421715feed68 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:24.613964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e9f4cdd9-a793-4810-b358-421715feed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:24.635314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:24.714880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 692/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:25.000197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:25.001734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:25.147954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f7ea-0b29-4399-a91c-d1173565c667 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:25.198570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:25.261314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:25.261930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:25.262215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:25.262491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:25.264138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:25.364220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:25.365826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9d067-954c-4904-9015-5ff4d330ad5d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:25.384642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 684/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:27.454684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:27.455136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:27.455244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:27.457339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 693/1377] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:27.462598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666317c-fe43-4a2e-a37a-50435a73f64b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:27.463001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666317c-fe43-4a2e-a37a-50435a73f64b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:27.463180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666317c-fe43-4a2e-a37a-50435a73f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:27.530916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c666317c-fe43-4a2e-a37a-50435a73f64b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:27.532161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c666317c-fe43-4a2e-a37a-50435a73f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:27.544222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:27.646058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 685/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:27.941020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:27.942537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:28.112689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33a819-0686-46ed-ab08-6a6f2684c29a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:28.116533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:28.225995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:28.226533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:28.226799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:28.227071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:28.228698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:28.326143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:28.327730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa66769-0867-4118-a5e3-31cbfff398d0 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:28.349022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 694/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:30.467696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:30.468218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:30.468325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:30.469737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 686/1380] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:30.474760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306d32-94ce-4fd0-b734-437e9b7ee3f8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:30.475155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306d32-94ce-4fd0-b734-437e9b7ee3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:30.475318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306d32-94ce-4fd0-b734-437e9b7ee3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:30.488146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:30.549483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ee306d32-94ce-4fd0-b734-437e9b7ee3f8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:30.550711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ee306d32-94ce-4fd0-b734-437e9b7ee3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:30.655062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 695/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:30.945680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:30.947334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:31.109671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:31.121494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc685-6948-4947-bffc-38279c77b798 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:31.247581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:31.248116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:31.248402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:31.248680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:31.250309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:31.351972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:31.356039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43f541-7a99-480b-bdf9-70912e79c7ed service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:31.365674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:31.375109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 687/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:33.433895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:33.434446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:33.434446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:33.435840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 696/1383] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:33.441054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334f37-c195-4ea4-82b9-f6cd3c96031f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:33.441575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334f37-c195-4ea4-82b9-f6cd3c96031f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:33.441748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334f37-c195-4ea4-82b9-f6cd3c96031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:33.508379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c7334f37-c195-4ea4-82b9-f6cd3c96031f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:33.509601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c7334f37-c195-4ea4-82b9-f6cd3c96031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:33.616617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 688/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:33.898304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:33.899996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:33.989642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:34.052987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6f14-9c51-4de3-ae67-422c0d0a587d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:34.168931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:34.169455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:34.169728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:34.170070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:34.171773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:34.221835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:34.262162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:34.263794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7952d-ce9f-441b-b016-a271143d5648 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:34.282624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 697/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:36.776972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:36.777578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:36.777752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:36.779541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 689/1386] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:36.785921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2746fa-4cce-4611-8335-584ef7fe024d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:36.786334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2746fa-4cce-4611-8335-584ef7fe024d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:36.786512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2746fa-4cce-4611-8335-584ef7fe024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:36.853535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8c2746fa-4cce-4611-8335-584ef7fe024d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:36.854780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8c2746fa-4cce-4611-8335-584ef7fe024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:36.954081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 698/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:29:37.335744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:37.337278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:37.416890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:37.497962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6dbe1-0a1f-48c5-bf6e-16740027fe9f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:37.611997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:37.612530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:37.612812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:37.613084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:37.614697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:37.654752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:37.720568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:37.722966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dd1d6-0bec-42ff-bc6e-1814619093c8 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:37.748008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 690/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:39.669916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d144b4-58a7-406a-b6cc-8443adcd68ff None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:39.670432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d144b4-58a7-406a-b6cc-8443adcd68ff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:39.670432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d144b4-58a7-406a-b6cc-8443adcd68ff None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:39.672053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 699/1389] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:39.677028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7041-6dc4-47f4-bce6-2b0fa88ec186 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:39.677450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7041-6dc4-47f4-bce6-2b0fa88ec186 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:39.677609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7041-6dc4-47f4-bce6-2b0fa88ec186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:39.747834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2dbc7041-6dc4-47f4-bce6-2b0fa88ec186 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:39.749076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2dbc7041-6dc4-47f4-bce6-2b0fa88ec186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:39.792769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d816ab-9563-4b16-89cc-187d911f4c79 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:39.793308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d816ab-9563-4b16-89cc-187d911f4c79 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:39.793582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d816ab-9563-4b16-89cc-187d911f4c79 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:39.794923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 700/1390] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:29:39.799917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8e57-c324-465f-b8bb-14dc251e1f18 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:39.800208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8e57-c324-465f-b8bb-14dc251e1f18 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:39.800487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd8e57-c324-465f-b8bb-14dc251e1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:39.838990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:39.850014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 691/1391] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:29:39.875902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c5fd8e57-c324-465f-b8bb-14dc251e1f18 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:39.877117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c5fd8e57-c324-465f-b8bb-14dc251e1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:39.978000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 701/1392] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:29:40.156734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:40.157050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:40.157330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:40.158835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 692/1393] 10.222.0.43 () {54 vars in 967 bytes} [Fri Aug 19 16:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:40.163966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:40.164254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:40.164531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:40.243437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] MFA Rules not processed for user `e1d6b286abb74772860b17905c9fa3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:40.244663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:40.296429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:40.298436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:40.300019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:40.317490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:40.326616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 702/1394] 10.222.0.43 () {58 vars in 1064 bytes} [Fri Aug 19 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:40.334268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:40.342104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43aa48-6ef3-4614-bc7f-9ff5aac171be None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:40.430971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:40.431604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:40.432083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:40.434118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:40.435824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:40.470419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5994a6-66b6-4f77-920a-ccf64863598f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:40.553129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:40.554720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47261035-3a0f-4e08-857f-844524872f25 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:40.569442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:40.572869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:40.574494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 703/1395] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:29:40.603053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:40.603686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:40.604584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:40.605059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:40.607902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:40.708488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:40.710091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680e2f7-7d0a-475c-ad0e-8ca63078fe72 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:40.728391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 693/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:29:41.469778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd084-8a13-41be-b77c-568e587001a7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:41.470259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd084-8a13-41be-b77c-568e587001a7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:41.470367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd084-8a13-41be-b77c-568e587001a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:41.539075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cbcbd084-8a13-41be-b77c-568e587001a7 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:41.540315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cbcbd084-8a13-41be-b77c-568e587001a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:41.631046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 704/1397] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:41.678029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:41.678352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:41.678633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:41.680041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 694/1398] 10.222.0.43 () {54 vars in 943 bytes} [Fri Aug 19 16:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:41.687146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb6e3-0ed8-4f12-836c-d725cf13ef22 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:41.687438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb6e3-0ed8-4f12-836c-d725cf13ef22 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:41.687751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb6e3-0ed8-4f12-836c-d725cf13ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:41.764679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-06efb6e3-0ed8-4f12-836c-d725cf13ef22 None None] MFA Rules not processed for user `c98929303e0e420e85db06478eb3d8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:41.765808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-06efb6e3-0ed8-4f12-836c-d725cf13ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:41.795627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:41.874647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 705/1399] 10.222.0.43 () {58 vars in 1040 bytes} [Fri Aug 19 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:41.884174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:41.886203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:41.992789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:42.039477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41debd-2e2b-4243-9ab3-6754cf0ddaca None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:42.142689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:42.143292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:42.143606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:42.143884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:42.145501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:42.230738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:42.232368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cad98-bf44-4f91-b05b-faa611e9e73e service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:42.235874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:42.240849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 695/1400] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:29:42.791615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:42.792322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:42.792322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:42.793785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 706/1401] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:42.799089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1b9b-7ce1-464e-8466-1e6074febe6a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:42.799385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1b9b-7ce1-464e-8466-1e6074febe6a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:42.799716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1b9b-7ce1-464e-8466-1e6074febe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:42.878432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cd3e1b9b-7ce1-464e-8466-1e6074febe6a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:42.879676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cd3e1b9b-7ce1-464e-8466-1e6074febe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:42.995529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 696/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:43.297876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:43.299427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:43.481248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822f9de-1f08-4e73-af52-fc28dd779c57 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:43.484380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:43.620914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:43.621863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:43.622157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:43.622430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:43.624101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:43.730386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:43.732164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6fbd-9799-48f6-a589-a927a2407d68 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:43.751971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 707/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:45.842393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:45.843047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:45.843047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:45.845367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 697/1404] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:29:45.849828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0707-7109-4fd7-a374-f53022d4910f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:45.850286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0707-7109-4fd7-a374-f53022d4910f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:45.850386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0707-7109-4fd7-a374-f53022d4910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:45.860418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:45.927540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-842f0707-7109-4fd7-a374-f53022d4910f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:45.927540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-842f0707-7109-4fd7-a374-f53022d4910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:46.049099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 708/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:46.372471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:46.372941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:46.465633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:46.546276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706462a-b6d9-472b-9304-d28799b3ad95 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:46.687446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:46.688467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:46.688922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:46.689365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:46.691218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:46.748079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:46.808503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:46.810473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4660d-1510-4387-9e1f-c6808a09ba35 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:46.832267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 698/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:48.887409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:48.887999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:48.887999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:48.890372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 709/1407] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:29:48.894665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3d45-1257-4d3d-b5f4-f9dcbb03bde8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:48.895086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3d45-1257-4d3d-b5f4-f9dcbb03bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:48.895218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3d45-1257-4d3d-b5f4-f9dcbb03bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:48.967550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-547c3d45-1257-4d3d-b5f4-f9dcbb03bde8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:29:48.969094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-547c3d45-1257-4d3d-b5f4-f9dcbb03bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:49.080981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 699/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:29:49.379256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:29:49.380819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:49.475690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:49.546835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846d0d-7a5c-43c5-9644-7e5f5c7ebea7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:29:49.684195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:29:49.685112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:29:49.685394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:29:49.685714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:29:49.687706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:29:49.739268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:49.787213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:29:49.790006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a16d7e-ecea-4b48-a711-45809e024460 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:29:49.812002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 710/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:29:59.079032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:59.809457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=24 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:05.586820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363dbbe-f201-4e57-ace2-56fd97d3b69b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:05.587349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363dbbe-f201-4e57-ace2-56fd97d3b69b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:05.587349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363dbbe-f201-4e57-ace2-56fd97d3b69b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:05.589381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 700/1410] 10.222.0.43 () {54 vars in 918 bytes} [Fri Aug 19 16:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:05.594618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32956-f98f-48ff-b4a3-024fb11725e9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:05.595066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32956-f98f-48ff-b4a3-024fb11725e9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:05.595194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32956-f98f-48ff-b4a3-024fb11725e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:05.669773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ddb32956-f98f-48ff-b4a3-024fb11725e9 None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:05.670894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ddb32956-f98f-48ff-b4a3-024fb11725e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:05.775961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 711/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:05.789883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb54f8-6893-4fcf-ad0b-1f2c81151f34 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:05.790175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb54f8-6893-4fcf-ad0b-1f2c81151f34 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:05.790458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb54f8-6893-4fcf-ad0b-1f2c81151f34 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:05.792014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 701/1412] 10.222.0.43 () {54 vars in 918 bytes} [Fri Aug 19 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:05.796881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90d9-9a55-4b65-86fe-490424de0c7b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:05.797171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90d9-9a55-4b65-86fe-490424de0c7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:05.797449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90d9-9a55-4b65-86fe-490424de0c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:05.869813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:05.872360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-24cd90d9-9a55-4b65-86fe-490424de0c7b None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:05.873596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-24cd90d9-9a55-4b65-86fe-490424de0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:05.988461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 712/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:08.413090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:08.413594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:08.413707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:08.414999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:08.420748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbb37-eaa2-4b84-b604-ddd343939ac0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:08.421173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbb37-eaa2-4b84-b604-ddd343939ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:08.421308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbb37-eaa2-4b84-b604-ddd343939ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:08.488683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2edfbb37-eaa2-4b84-b604-ddd343939ac0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:08.489805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2edfbb37-eaa2-4b84-b604-ddd343939ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:08.546894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:08.589330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:08.882395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:08.883953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:09.029489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab9ece-8d83-4db4-8c47-31b13d3a9891 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:09.102480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:09.146932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:09.147478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:09.147805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:09.148087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:09.149710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:09.238303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:09.239909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cf7c0-d323-4f50-960e-596af6f920e4 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:09.257920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 703/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:10.152913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:10.153405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:10.153405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:10.154790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:10.159664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eed1c-9af7-4b8b-90f5-57296b0fa9f9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:10.160066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eed1c-9af7-4b8b-90f5-57296b0fa9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:10.160230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eed1c-9af7-4b8b-90f5-57296b0fa9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:10.235645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bb0eed1c-9af7-4b8b-90f5-57296b0fa9f9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:10.236846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb0eed1c-9af7-4b8b-90f5-57296b0fa9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:10.268196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:10.338827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:10.492665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:10.494228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:10.640146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63066973-5aad-418c-83e6-482bb8d30940 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:10.679537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:10.753453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:10.753988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:10.754265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:10.754535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:10.756160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:10.844505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:10.846100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ed849-daf3-49d5-a0a1-f024d9ee9c8f service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:10.864682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 715/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:11.757410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:11.757897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:11.757897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:11.759231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:11.764885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c025-c3de-4d39-8642-a72ceecedcb8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:11.765312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c025-c3de-4d39-8642-a72ceecedcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:11.765436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c025-c3de-4d39-8642-a72ceecedcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:11.820711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:11.844147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fa81c025-c3de-4d39-8642-a72ceecedcb8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:11.845420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa81c025-c3de-4d39-8642-a72ceecedcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:11.952951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:12.105288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:12.106944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:12.262531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47211b-7370-4cc8-8bf0-41caeab4efed None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:12.275591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:12.382966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:12.383606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:12.383894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:12.384173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:12.385822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:12.474359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:12.476145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2068-86b9-4011-966b-bd59cfb800fa service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:12.495110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 706/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:13.377309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:13.377775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:13.377911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:13.379227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:13.384207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce739-a3ca-48bc-85f1-f814fa20ccf7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:13.384669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce739-a3ca-48bc-85f1-f814fa20ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:13.385020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce739-a3ca-48bc-85f1-f814fa20ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:13.405402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:13.463806 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-888ce739-a3ca-48bc-85f1-f814fa20ccf7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:13.465025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-888ce739-a3ca-48bc-85f1-f814fa20ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:13.561897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:13.714869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:13.716348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:13.826276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:13.861662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e48dde-8a9e-4c0b-bb95-8d99b8cf5757 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:13.978957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:13.979530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:13.979815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:13.980086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:13.981690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:14.057540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:14.070700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:14.072779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c641fd-eb35-4fc6-8e24-ec5d233f6efb service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:14.091169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 718/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:14.949376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:14.949881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:14.949997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:14.951254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:14.956238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313da1a5-876e-47a3-a450-bb9a58ec4f3d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:14.956640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313da1a5-876e-47a3-a450-bb9a58ec4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:14.956966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313da1a5-876e-47a3-a450-bb9a58ec4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:15.032358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-313da1a5-876e-47a3-a450-bb9a58ec4f3d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:15.033552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-313da1a5-876e-47a3-a450-bb9a58ec4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:15.129019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:15.279241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:15.280829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:15.370885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:15.434582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0870b1-6b4b-44de-85a2-da94449ee687 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:15.548330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:15.548950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:15.549229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:15.549501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:15.551100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:15.600440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:15.641925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:15.643599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6b564-e1d3-4470-bd7e-daeb2191313e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:15.662022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 709/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:16.545929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:16.546463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:16.546463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:16.547875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:16.552828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834733ee-0a63-4488-ae3c-12ce8746425b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:16.558171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834733ee-0a63-4488-ae3c-12ce8746425b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:16.558171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834733ee-0a63-4488-ae3c-12ce8746425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:16.630389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-834733ee-0a63-4488-ae3c-12ce8746425b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:16.631536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-834733ee-0a63-4488-ae3c-12ce8746425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:16.733858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:16.886232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:16.887721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:16.936297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:17.030999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da102dbc-ad82-4b11-9b98-5d99dbbc13ec None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:17.144079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:17.144607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:17.144886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:17.145163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:17.146752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:17.154186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:17.235721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:17.237312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3f109-c2e7-4e90-b625-89ea958717db service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:17.255218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 721/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:18.122753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:18.123347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:18.123347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:18.124753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:18.129613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5887c-26cd-4218-9e3f-06c71649c4ce None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:18.130047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5887c-26cd-4218-9e3f-06c71649c4ce None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:18.130148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5887c-26cd-4218-9e3f-06c71649c4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:18.207418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d7b5887c-26cd-4218-9e3f-06c71649c4ce None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:18.208605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d7b5887c-26cd-4218-9e3f-06c71649c4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:18.280624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:18.311264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:18.465351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:18.466797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:18.487208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:18.616538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517c76-68d5-4ff4-9d4d-5fb22043967e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:18.704301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:18.730231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:18.730822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:18.731297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:18.731612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:18.733763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:18.822853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:18.824477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149179d0-85a7-4781-a985-562243ec45e9 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:18.842742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 712/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:19.721350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:19.721876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:19.721876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:19.723219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:19.728270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9c1c-4360-43b5-bfcc-0294e0efdbca None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:19.728791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9c1c-4360-43b5-bfcc-0294e0efdbca None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:19.729096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9c1c-4360-43b5-bfcc-0294e0efdbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:19.805048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-77db9c1c-4360-43b5-bfcc-0294e0efdbca None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:19.806969 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-77db9c1c-4360-43b5-bfcc-0294e0efdbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:19.847869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:19.903208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:20.059149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:20.060649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:20.209581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f7df4-147a-4389-a3f0-6a180a3aa75b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:20.265337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:20.323891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:20.324497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:20.324773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:20.325042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:20.326635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:20.414730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:20.416493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295fb2c-bf18-4859-9533-247ee123ba07 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:20.434806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 724/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:21.310182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:21.310702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:21.310702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:21.312092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:21.316988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f69d-5197-4da7-bac7-1606476d6af3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:21.317404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f69d-5197-4da7-bac7-1606476d6af3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:21.317542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f69d-5197-4da7-bac7-1606476d6af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:21.394023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d585f69d-5197-4da7-bac7-1606476d6af3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:21.395280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d585f69d-5197-4da7-bac7-1606476d6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:21.397429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:21.492909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:21.645740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:21.647260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:21.793390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da303cb7-10a6-42da-b71b-e9650a3f52bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:21.820295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:21.909545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:21.910261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:21.910442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:21.910721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:21.912405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:22.001994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:22.003638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d503-1229-4cfa-b3a8-1ab9d9be73ed service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:22.021985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 715/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:23.872520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:23.873108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:23.873108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:23.874429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:23.879747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8e60-81db-4dc0-90dc-0d7bd8222829 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:23.880177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8e60-81db-4dc0-90dc-0d7bd8222829 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:23.880304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8e60-81db-4dc0-90dc-0d7bd8222829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:23.922556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:23.946725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-204e8e60-81db-4dc0-90dc-0d7bd8222829 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:23.947954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-204e8e60-81db-4dc0-90dc-0d7bd8222829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:24.047910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:24.340518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:24.342063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:24.444400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb62d-75bc-482d-bf5d-2905bdda22ad None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:24.475206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:24.517312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:24.517920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:24.518195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:24.518462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:24.520071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:24.628747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:24.630147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7314e8-14a6-4e12-abe2-d0f31121c8ac service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:24.648813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 727/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:26.771198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:26.771739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:26.771739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:26.773047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:26.778583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef458-3c1e-48b5-8a45-ebff86a7512f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:26.779023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef458-3c1e-48b5-8a45-ebff86a7512f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:26.779145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bef458-3c1e-48b5-8a45-ebff86a7512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:26.845053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f6bef458-3c1e-48b5-8a45-ebff86a7512f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:26.846414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f6bef458-3c1e-48b5-8a45-ebff86a7512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:26.860847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:26.944006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:27.234082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:27.235667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:27.342500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f79db-9c01-4f6c-a28c-c3d0b944fa1c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:27.356882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:27.421938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:27.422549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:27.422828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:27.423099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:27.424744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:27.548513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:27.548513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad79ad-960f-463f-9f0f-3a4bcbf27755 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:27.567445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 718/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:29.948508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3b03-311c-4246-96de-0fa72889626d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:29.949037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3b03-311c-4246-96de-0fa72889626d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:29.949037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3b03-311c-4246-96de-0fa72889626d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:29.950401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:29.957007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1926-bba0-4ba6-a377-7953bb6a736d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:29.957471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1926-bba0-4ba6-a377-7953bb6a736d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:29.957574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1926-bba0-4ba6-a377-7953bb6a736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:30.011589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:30.029948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-714f1926-bba0-4ba6-a377-7953bb6a736d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:30.045877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-714f1926-bba0-4ba6-a377-7953bb6a736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:30.132099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:30.417617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3b03-311c-4246-96de-0fa72889626d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:30.419456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42af3b03-311c-4246-96de-0fa72889626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:30.523850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3b03-311c-4246-96de-0fa72889626d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:30.565943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:30.601669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:30.602388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:30.602709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:30.602983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:30.604623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:30.718105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:30.719633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbec34-895e-4127-a670-217ad2fad055 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:30.738859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 730/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:30:32.801936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:32.802429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:32.802429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:32.803799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:32.809145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7509-3767-4e32-8f7c-f71fbc2b5ab3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:32.809589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7509-3767-4e32-8f7c-f71fbc2b5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:32.809847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7509-3767-4e32-8f7c-f71fbc2b5ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:32.877141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-886a7509-3767-4e32-8f7c-f71fbc2b5ab3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:32.878402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-886a7509-3767-4e32-8f7c-f71fbc2b5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:32.901654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:32.982882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:33.279109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:33.280761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:33.394314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c725b39-39e4-4942-9bd9-ae2ea1c63d78 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:33.415518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:33.471964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:33.472606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:33.472890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:33.473196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:33.474811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:33.590098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:33.591726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe99bd-60d2-4d57-b45d-16fa96fc24a8 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:33.611434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 721/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:30:35.676111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:35.676639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:35.676639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:35.677944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:35.683387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7dab6-07a5-4aed-a4cc-083b43929e90 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:35.683865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7dab6-07a5-4aed-a4cc-083b43929e90 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:35.684119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7dab6-07a5-4aed-a4cc-083b43929e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:35.747408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:35.749995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-94b7dab6-07a5-4aed-a4cc-083b43929e90 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:35.751191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-94b7dab6-07a5-4aed-a4cc-083b43929e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:35.847678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:36.140168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:36.141720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:36.244641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5b13-4614-4ef5-8baa-833284d91520 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:36.299592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:36.326226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:36.326848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:36.327123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:36.327392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:36.329052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:36.443652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:36.445020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd26e8-9fe3-4183-a504-939f32a837e2 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:36.463546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 733/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:38.450013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:38.450533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:38.450649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:38.451976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:38.457310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e4dd-7eb0-49a4-b474-55d9eccf2de1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:38.457738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e4dd-7eb0-49a4-b474-55d9eccf2de1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:38.457868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e4dd-7eb0-49a4-b474-55d9eccf2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:38.523921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8be5e4dd-7eb0-49a4-b474-55d9eccf2de1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:38.526096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8be5e4dd-7eb0-49a4-b474-55d9eccf2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:38.555119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:38.624536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:38.913214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:38.915309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:39.018019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b216-a4f8-4125-865b-27a5f28abd27 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:39.049609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:39.096690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:39.097321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:39.097635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:39.097915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:39.099626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:39.208336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:39.209697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4705-b37c-4a1c-9893-320e93eb7d81 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:39.227893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 724/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:41.232259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:41.232828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:41.232828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:41.234194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:41.239356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a101-ab4b-4fae-94ed-6c798be925c7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:41.239775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a101-ab4b-4fae-94ed-6c798be925c7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:41.239944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a101-ab4b-4fae-94ed-6c798be925c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:41.307168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5ef5a101-ab4b-4fae-94ed-6c798be925c7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:41.308425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5ef5a101-ab4b-4fae-94ed-6c798be925c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:41.316735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:41.408414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:41.692477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:41.694042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:41.799938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977e40-1cc5-44da-9641-2a2396033171 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:41.867063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:41.887153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:41.887788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:41.888068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:41.888342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:41.889934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:42.001758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:42.003099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b548836-3d7b-401a-8450-9a2e66564e9b service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:42.023251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 736/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:44.044297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:44.045117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:44.045117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:44.046189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:44.051626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee36e-8be8-440f-8888-b0f17e238970 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:44.052019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee36e-8be8-440f-8888-b0f17e238970 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:44.052179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee36e-8be8-440f-8888-b0f17e238970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:44.120491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fceee36e-8be8-440f-8888-b0f17e238970 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:44.121701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fceee36e-8be8-440f-8888-b0f17e238970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:44.159931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:44.218429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:44.511639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:44.513217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:44.620922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee24a9-9806-4258-836c-0ba789d172f3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:44.659137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:44.695601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:44.696831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:44.697055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:44.697323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:44.698914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:44.925973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:44.927326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0e7d-b048-4931-b4fd-910b94ee8415 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:44.946682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 727/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:46.869472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:46.870034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:46.870034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:46.871423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:46.876679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4373-6434-4f60-a6b0-06c29c101158 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:46.877095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4373-6434-4f60-a6b0-06c29c101158 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:46.877226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4373-6434-4f60-a6b0-06c29c101158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:46.942438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c72a4373-6434-4f60-a6b0-06c29c101158 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:46.943688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c72a4373-6434-4f60-a6b0-06c29c101158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:46.961714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:47.040518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:47.322925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:47.324499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:47.496670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c69b-c572-41de-b0ed-605ebdd54145 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:47.504329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:47.511603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:47.512213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:47.512496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:47.512771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:47.514407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:47.622949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:47.624343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0e1a2-e213-4593-997e-2fd1c1476c79 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:47.642445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 739/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:49.575165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:49.575792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:49.575792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:49.577160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:30:49.582390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825d33-7120-44c6-b924-aff85a71652d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:49.582833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825d33-7120-44c6-b924-aff85a71652d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:49.582942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11825d33-7120-44c6-b924-aff85a71652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:49.652018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-11825d33-7120-44c6-b924-aff85a71652d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:30:49.653161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11825d33-7120-44c6-b924-aff85a71652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:49.702006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:49.750635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:30:50.029440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:30:50.031016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:50.134900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24f0b-9d99-4073-a7fd-c00ce4783a9e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:30:50.182834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:30:50.207086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:30:50.207711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:30:50.207990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:30:50.208260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:30:50.209838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:30:50.317679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:30:50.319145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d552b6-2655-4398-84b8-bb15db08ae51 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:30:50.337411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 730/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:30:59.748954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=22 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:00.334659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=66 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:10.056173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1a47-8250-4013-bfa9-89b79a614524 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:10.056695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1a47-8250-4013-bfa9-89b79a614524 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:10.056695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1a47-8250-4013-bfa9-89b79a614524 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:10.058043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 741/1471] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:10.063148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891dd1-6a1c-4afd-b936-18177ffe90a3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:10.063629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891dd1-6a1c-4afd-b936-18177ffe90a3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:10.063732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891dd1-6a1c-4afd-b936-18177ffe90a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:10.128104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-52891dd1-6a1c-4afd-b936-18177ffe90a3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:10.129315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52891dd1-6a1c-4afd-b936-18177ffe90a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:10.223962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 731/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:10.520700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:10.520986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:10.521264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:10.522616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 742/1473] 10.222.0.43 () {54 vars in 967 bytes} [Fri Aug 19 16:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:10.527857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e044d1-eeea-4a3d-bfca-0321ea592bfa None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:10.528217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e044d1-eeea-4a3d-bfca-0321ea592bfa None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:10.528500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e044d1-eeea-4a3d-bfca-0321ea592bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:10.603497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2e044d1-eeea-4a3d-bfca-0321ea592bfa None None] MFA Rules not processed for user `e1d6b286abb74772860b17905c9fa3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:10.604703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2e044d1-eeea-4a3d-bfca-0321ea592bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:10.625989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:10.681068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 732/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Fri Aug 19 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:10.688493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:10.690001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:10.791920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7fca0-4e77-45b6-9720-e8710903c178 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:10.864763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:10.865372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:10.865656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:10.865930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:10.868229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:10.921348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:10.974885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:10.976862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad31a2-cecb-421a-bf08-293b55b15659 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:10.995387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 743/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:12.996075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:12.996648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:12.996648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:12.998017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 733/1476] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:13.003201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127c92-441d-4df4-b98e-8bf2b8a01e18 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:13.003674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127c92-441d-4df4-b98e-8bf2b8a01e18 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:13.003822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127c92-441d-4df4-b98e-8bf2b8a01e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:13.070118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e1127c92-441d-4df4-b98e-8bf2b8a01e18 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:13.071349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e1127c92-441d-4df4-b98e-8bf2b8a01e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:13.168437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 744/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:13.442086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:13.443672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:13.567713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7016aae-a2db-42d9-b4f0-4e19d2563b1b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:13.616118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:13.660995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:13.661603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:13.661880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:13.662149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:13.662785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:13.664666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:31:13.664666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:31:13.664666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:31:13.665804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79766a4-c52e-4cdd-b8c4-fe31a5726a37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:13.684856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 734/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 16:31:13 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:31:15.610662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:15.611161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:15.611161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:15.612501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 745/1479] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:15.618558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85153c-e8dd-491d-9434-f198f63cc287 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:15.618978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85153c-e8dd-491d-9434-f198f63cc287 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:15.619116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85153c-e8dd-491d-9434-f198f63cc287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:15.684944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5b85153c-e8dd-491d-9434-f198f63cc287 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:15.686149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b85153c-e8dd-491d-9434-f198f63cc287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:15.781841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 735/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:16.077742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:16.079285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:16.089670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:16.222190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369814a-7ad2-4400-8e89-d748cea3393f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:16.300053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:16.331840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:16.332450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:16.332723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:16.332993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:16.335258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:16.425301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:16.426907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d01aa-5986-4919-86b8-9327ac19e436 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:16.444874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 746/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:18.552325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:18.552850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:18.552850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:18.554783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 736/1482] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:18.560061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f2ef-5914-460c-85c1-1f29718c4604 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:18.560479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f2ef-5914-460c-85c1-1f29718c4604 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:18.560726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f2ef-5914-460c-85c1-1f29718c4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:18.626171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-54b9f2ef-5914-460c-85c1-1f29718c4604 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:18.627407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54b9f2ef-5914-460c-85c1-1f29718c4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:18.674154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:18.723361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 747/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:19.014928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:19.016564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:19.040392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:19.120789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e4dc7-2445-421e-81fd-6fda7c785015 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:19.199057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:19.199699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:19.199987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:19.200268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:19.201872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:19.282003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:19.316332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:19.317824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958de6-b6a5-45cc-9de2-fea076182c56 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:19.337402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 737/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:21.319565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:21.320864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:21.320864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:21.321959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 748/1485] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:21.327211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1274-407b-4d63-b941-373e62b677a9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:21.327642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1274-407b-4d63-b941-373e62b677a9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:21.327792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1274-407b-4d63-b941-373e62b677a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:21.393443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f9fe1274-407b-4d63-b941-373e62b677a9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:21.394635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f9fe1274-407b-4d63-b941-373e62b677a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:21.489056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 738/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:21.777344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:21.778932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:21.883406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea1b1f-24b6-4ceb-8b0a-070d8a37e639 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:21.953537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:21.955345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:21.956010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:21.956291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:21.956564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:21.958169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:22.068306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:22.070244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5504e-bcdc-4937-82e2-fb724ad3b223 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:22.089271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 749/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:24.183172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:24.183743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:24.183743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:24.185087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 739/1488] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:24.190175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef73b-85fb-400b-ac95-a9a6c219316e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:24.190571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef73b-85fb-400b-ac95-a9a6c219316e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:24.190722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef73b-85fb-400b-ac95-a9a6c219316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:24.258060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e84ef73b-85fb-400b-ac95-a9a6c219316e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:24.259228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e84ef73b-85fb-400b-ac95-a9a6c219316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:24.311807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:24.355255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 750/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:24.649690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:24.651239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:24.687955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:24.755626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5d3b0-0c1c-4c72-bd33-d0767f780679 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:24.829776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:24.830389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:24.830674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:24.830953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:24.832667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:24.911389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:24.941518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:24.942935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada891ca-3c8d-4f18-a057-ae354da01e4d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:24.961722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 740/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:27.318848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:27.319411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:27.319411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:27.321053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 751/1491] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 16:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:31:27.326427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760364e-e493-48d3-b97c-f41e08127d50 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:27.326848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760364e-e493-48d3-b97c-f41e08127d50 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:27.326963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760364e-e493-48d3-b97c-f41e08127d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:27.392657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8760364e-e493-48d3-b97c-f41e08127d50 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:31:27.393865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8760364e-e493-48d3-b97c-f41e08127d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:27.488292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 741/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:31:27.780906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:31:27.782440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:27.885310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ed57-5270-4f37-9e78-1484a360fbb6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:31:27.957664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:31:27.958279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:31:27.958566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:31:27.958930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:31:27.961272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:31:27.970608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:28.073220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:31:28.075465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ce58-8f13-406f-9679-9bf53d393873 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:31:28.093663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 752/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:31:37.486516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=82 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:38.091318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=50 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:51.588105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:51.588740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:51.588740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:51.664523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:32:51.665695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:51.763235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 742/1494] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:32:51.771439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:51.771969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:51.772076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:51.846309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:32:51.847553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:51.943954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 753/1495] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:32:51.948674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:51.949941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:51.961739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d232-deb7-4395-9e27-5aa15ed5464e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:52.023430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:52.057649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:52.058258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:52.058538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:52.058812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:52.059451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:32:52.059808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:52.060915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:52.060915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:32:52.060915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:32:52.061842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:52.073437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 743/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:32:52.081770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:52.091578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd63d0-478c-475f-a23f-5a0a89268e49 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:52.153402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:52.195672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:52.196326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:52.196653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:52.197191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:52.197812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:52.199551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:52.199551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:32:52.199551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:32:52.200738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:52.322298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 754/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:32:52 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:32:52.326732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:52.328317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:52.366363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8f0b-b090-42ca-a31a-56486bd6ea91 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:52.461708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:52.462233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:52.462513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:52.462785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:52.463403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:52.464439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:52.464439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:32:52.464439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:32:52.465650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:52.596849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 744/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:32:52 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:32:52.601301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:52.602893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:52.666035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562ca2-e2dc-4aa9-89ca-a482a3294129 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:52.749364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:52.760034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:52.760635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:52.760935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:52.761187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:52.761824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:52.762838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:52.762838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:32:52.762838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:32:52.763754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:52.775938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 755/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:32:52.780253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:52.781778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:52.793623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494445-9ba5-4cc0-9217-6e77e8ebd5dd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:52.818869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:52.888797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:52.889401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:52.889683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:52.889957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:52.890594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:52.891634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:52.891634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:32:52.891634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:32:52.892528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61fcda-5313-46b5-ba15-51094f8ae202 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:52.904694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 745/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:32:52.908875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:52.910447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:52.943505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafde0-ce63-439a-89bc-0d80e6f65d78 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:53.036191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:53.036777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.037060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.037337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] PATH_INFO: `/v3/projects/bb328af964a24dc88a4ccce0833a9651/users/97ceb26ff46444aa806ca49e24060a8d/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.059612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb328af964a24dc88a4ccce0833a9651, user_id=97ceb26ff46444aa806ca49e24060a8d, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:53.060637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:53.060637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:32:53.060637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:32:53.062587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1a80-0dd1-4ef7-8cdc-77f2acf5d451 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:53.155198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 756/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:32:52 2022] PUT /identity/v3/projects/bb328af964a24dc88a4ccce0833a9651/users/97ceb26ff46444aa806ca49e24060a8d/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:32:53.168877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e262-f528-4a4f-b7a4-ea5e99b002f9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.169150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e262-f528-4a4f-b7a4-ea5e99b002f9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.169427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e262-f528-4a4f-b7a4-ea5e99b002f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.226192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-33c5e262-f528-4a4f-b7a4-ea5e99b002f9 None None] MFA Rules not processed for user `97ceb26ff46444aa806ca49e24060a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:32:53.227422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-33c5e262-f528-4a4f-b7a4-ea5e99b002f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:53.304931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 746/1502] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:32:53.317891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.318178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.318455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.320080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 757/1503] 10.222.0.43 () {54 vars in 964 bytes} [Fri Aug 19 16:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:32:53.324712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a76f-9d8a-4b50-b2c7-7559d14357e2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.325000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a76f-9d8a-4b50-b2c7-7559d14357e2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.325275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a76f-9d8a-4b50-b2c7-7559d14357e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.356268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:53.402173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-95b9a76f-9d8a-4b50-b2c7-7559d14357e2 None None] MFA Rules not processed for user `7ecf96598f034c928195d02f98059469`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:32:53.403374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95b9a76f-9d8a-4b50-b2c7-7559d14357e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:53.477824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 747/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Aug 19 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:32:53.485636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:53.487197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:53.537155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:53.591563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad82b83-5d04-4e24-b844-ceb7c510bb6e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:53.664720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:53.665347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.665636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.665901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.667548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:53.766106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:53.767573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:53.770999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:53.786429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 758/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:32:53.831317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c685-3804-4c13-9d23-0b00b9183f53 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:53.831783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c685-3804-4c13-9d23-0b00b9183f53 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:53.831915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c685-3804-4c13-9d23-0b00b9183f53 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:53.833286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 748/1506] 10.222.0.43 () {52 vars in 830 bytes} [Fri Aug 19 16:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:32:53.837410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:53.838629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:53.938950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7d440-fc8a-43dc-a949-994046228c35 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:54.032490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:54.033117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:54.033398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:54.033678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] PATH_INFO: `/v3/users/97ceb26ff46444aa806ca49e24060a8d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:54.045852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ceb26ff46444aa806ca49e24060a8d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:54.046873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:54.046873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:32:54.046873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:32:54.048134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:54.057880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.281411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ceb26ff46444aa806ca49e24060a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:54.297099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ceb26ff46444aa806ca49e24060a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:54.297567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ceb26ff46444aa806ca49e24060a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:54.321296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ceb26ff46444aa806ca49e24060a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:54.321858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ceb26ff46444aa806ca49e24060a8d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:54.387964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 759/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:32:53 2022] DELETE /identity/v3/users/97ceb26ff46444aa806ca49e24060a8d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:32:54.392355 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:54.392646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:54.392930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:54.451916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:32:54.453119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:54.527001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.541372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 749/1508] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:32:54.548892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:54.550100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:54.649831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c010-19df-4d06-b503-2aaefeaf75da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:54.704169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.722985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:54.723656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:54.723954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:54.724230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:54.726415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:54.895052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:54.896526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118318-4718-433d-ba1c-5de2a0337e49 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:54.916346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 760/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:32:55.390459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:32:55.391994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:32:55.404652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a1f97-c2ac-4edc-8c44-8a7f08222560 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:32:55.504212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:32:55.504856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:32:55.505140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:32:55.505420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] PATH_INFO: `/v3/projects/bb328af964a24dc88a4ccce0833a9651` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:32:55.516155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb328af964a24dc88a4ccce0833a9651)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:32:55.517177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:32:55.517177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:32:55.517177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:32:55.518383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:32:55.632128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb328af964a24dc88a4ccce0833a9651', 'request_id': 'req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:55.638675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb328af964a24dc88a4ccce0833a9651', 'request_id': 'req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:55.732720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb328af964a24dc88a4ccce0833a9651', 'request_id': 'req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:55.765140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] The token cache is being invalidate because project bb328af964a24dc88a4ccce0833a9651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:32:55.765431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:55.766045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b4852ea9-85bf-40d6-ba5e-99f85ae0726a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:32:55.767318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 750/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:32:55 2022] DELETE /identity/v3/projects/bb328af964a24dc88a4ccce0833a9651 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:33:04.917741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=62 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:05.763204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:33.816618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:33.817196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:33.817196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:33.818504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:33.823439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2875db-af5d-4a3a-a98d-28ea9dbdd0f5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:33.823898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2875db-af5d-4a3a-a98d-28ea9dbdd0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:33.824004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2875db-af5d-4a3a-a98d-28ea9dbdd0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:33.909018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2b2875db-af5d-4a3a-a98d-28ea9dbdd0f5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:33.910223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2b2875db-af5d-4a3a-a98d-28ea9dbdd0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:34.012941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:34.171712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:34.173846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:34.295828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1e692-fa20-4a10-89a5-ba4ff43b9dfd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:34.301320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:34.301928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:34.302214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:34.302493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:34.311817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:34.313426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eaf34-ef63-4573-a57b-5903430425e1 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:34.322937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 762/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:34.866455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad160-99e7-458e-8c2c-5505f29e65a7 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:34.867030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad160-99e7-458e-8c2c-5505f29e65a7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:34.867030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad160-99e7-458e-8c2c-5505f29e65a7 None None] PATH_INFO: `/v3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:34.869078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 752/1514] 10.222.0.76 () {54 vars in 925 bytes} [Fri Aug 19 16:34:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:34:34.876201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789188aa-ba04-4b43-8bb1-1f6761531971 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:34.876614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789188aa-ba04-4b43-8bb1-1f6761531971 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:34.876819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789188aa-ba04-4b43-8bb1-1f6761531971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:34.946022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-789188aa-ba04-4b43-8bb1-1f6761531971 None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:34.947414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-789188aa-ba04-4b43-8bb1-1f6761531971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:35.017999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:35.023232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 763/1515] 10.222.0.76 () {58 vars in 1015 bytes} [Fri Aug 19 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:35.158988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ff5dc-6e7b-4d06-88c9-ab740196aeb5 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:35.159226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ff5dc-6e7b-4d06-88c9-ab740196aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:35.159525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ff5dc-6e7b-4d06-88c9-ab740196aeb5 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:35.160886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 753/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:35.166406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50357ae-7954-4502-8bb5-109ba70c57a1 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:35.166699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50357ae-7954-4502-8bb5-109ba70c57a1 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:35.166982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50357ae-7954-4502-8bb5-109ba70c57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:35.186740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f50357ae-7954-4502-8bb5-109ba70c57a1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:35.187980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f50357ae-7954-4502-8bb5-109ba70c57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:35.195873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 764/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:34:35.345884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ff5dc-6e7b-4d06-88c9-ab740196aeb5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:35.361194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ff5dc-6e7b-4d06-88c9-ab740196aeb5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:35.366636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:35.367948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:35.368218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:35.368492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:35.377045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:35.378733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e3085-e8c4-4c0a-9911-3da956f74309 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:35.388585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 754/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:43.940100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f58b82-dd1e-47ea-9f17-91328d231af2 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:43.940645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f58b82-dd1e-47ea-9f17-91328d231af2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:43.940645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f58b82-dd1e-47ea-9f17-91328d231af2 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:43.941955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 765/1519] 10.222.0.43 () {54 vars in 961 bytes} [Fri Aug 19 16:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:43.948240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634c-7b3e-4d12-97ee-058225395af4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:43.948710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634c-7b3e-4d12-97ee-058225395af4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:43.948876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634c-7b3e-4d12-97ee-058225395af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:43.968519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-357f634c-7b3e-4d12-97ee-058225395af4 None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:43.969737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-357f634c-7b3e-4d12-97ee-058225395af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:43.978348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 755/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Aug 19 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:43.986241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f58b82-dd1e-47ea-9f17-91328d231af2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:44.000279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f58b82-dd1e-47ea-9f17-91328d231af2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:44.005237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:44.005829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:44.006113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:44.006413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:44.015266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:44.016886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf5785-2612-4795-a824-2421eeda04f9 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:44.026464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 766/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:34:46.647004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2af2-5461-4e5c-ab48-fd120d88e5ff None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:46.647594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2af2-5461-4e5c-ab48-fd120d88e5ff None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:46.647594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2af2-5461-4e5c-ab48-fd120d88e5ff None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:46.649615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:46.654465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bfa56-bf44-4be6-ad5e-7035075eea99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:46.654910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bfa56-bf44-4be6-ad5e-7035075eea99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:46.655019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bfa56-bf44-4be6-ad5e-7035075eea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:46.674162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ae0bfa56-bf44-4be6-ad5e-7035075eea99 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:46.675442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ae0bfa56-bf44-4be6-ad5e-7035075eea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:46.683809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:46.859356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2af2-5461-4e5c-ab48-fd120d88e5ff None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:46.874359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2af2-5461-4e5c-ab48-fd120d88e5ff None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:46.880022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:46.881658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:46.881658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:46.881658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:46.889949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:46.891552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb5257-2e40-4ff7-b589-91233f329d37 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:46.901513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 757/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:47.733435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac26e3-786b-4784-9c94-782dea5c0dad None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:47.733965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac26e3-786b-4784-9c94-782dea5c0dad None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:47.733965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac26e3-786b-4784-9c94-782dea5c0dad None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:47.735305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:47.740083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fdd9-43a4-4160-ba2c-58951e49f19a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:47.740502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fdd9-43a4-4160-ba2c-58951e49f19a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:47.740637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fdd9-43a4-4160-ba2c-58951e49f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:47.760845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3814fdd9-43a4-4160-ba2c-58951e49f19a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:47.762033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3814fdd9-43a4-4160-ba2c-58951e49f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:47.769792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:47.921054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac26e3-786b-4784-9c94-782dea5c0dad None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:47.936000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac26e3-786b-4784-9c94-782dea5c0dad None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:47.941426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:47.942027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:47.942312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:47.942587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:47.950824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:47.952433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c0082-3037-45fd-a311-8d85eaa01484 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:47.962086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 769/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:51.717675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:51.718233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:51.718233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:51.719500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:51.724683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b6b7-dc76-45f8-b0a3-6985bdbcb111 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:51.725107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b6b7-dc76-45f8-b0a3-6985bdbcb111 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:51.725214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5b6b7-dc76-45f8-b0a3-6985bdbcb111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:51.744212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e7e5b6b7-dc76-45f8-b0a3-6985bdbcb111 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:51.745389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e7e5b6b7-dc76-45f8-b0a3-6985bdbcb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:51.753067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:52.043254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:52.045015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:52.079315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:52.125122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c148f2-b892-444d-bd90-b61e22462373 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:52.128722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:52.129323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:52.129603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:52.129875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:52.139422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:52.140859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0040-910f-4813-89e1-e0a464f86cba service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:52.150432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 760/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:54.058335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:54.058898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:54.058898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:54.060265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:54.065723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d0-022b-46cc-a7ef-e4853129b017 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:54.066095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d0-022b-46cc-a7ef-e4853129b017 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:54.066284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d0-022b-46cc-a7ef-e4853129b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:54.086708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d1e8e3d0-022b-46cc-a7ef-e4853129b017 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:54.087993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d1e8e3d0-022b-46cc-a7ef-e4853129b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:54.096198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:34:54.385634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:54.387321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:54.400613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8a040-3866-465c-8a53-f10a5683546b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:54.405701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:54.405701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:54.405701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:54.405701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:54.415185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:54.416672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a665e2c-66a3-48c8-8080-cb1a11ca6992 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:54.426534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 772/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:34:57.969798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:57.970364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:57.970364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:57.971746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:34:57.976986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20469-2967-4ad7-a616-fe54d3f3ccfc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:57.977423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20469-2967-4ad7-a616-fe54d3f3ccfc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:57.977539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20469-2967-4ad7-a616-fe54d3f3ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:57.997355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c6a20469-2967-4ad7-a616-fe54d3f3ccfc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:34:57.998562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6a20469-2967-4ad7-a616-fe54d3f3ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:58.006359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:34:58.572536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:34:58.574398 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:34:58.651290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c15bf-976c-4b3b-8a72-1886b6a1a738 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:34:58.654797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:34:58.655398 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:34:58.655774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:34:58.656046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:34:58.665003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:34:58.667024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417800-b5f4-4c86-857e-3d7701ad60c0 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:34:58.676176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 763/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:35:00.599407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:35:00.600017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:35:00.600017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:35:00.601347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:35:00.607139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de7a3-da0d-4636-a77b-011665b2f166 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:35:00.607582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de7a3-da0d-4636-a77b-011665b2f166 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:35:00.607697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de7a3-da0d-4636-a77b-011665b2f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:35:00.627417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f60de7a3-da0d-4636-a77b-011665b2f166 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:35:00.628676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f60de7a3-da0d-4636-a77b-011665b2f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:35:00.636527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:35:01.193204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:35:01.194884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:35:01.207985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440f234-66dd-43c4-a195-820dc7b6af3e None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:35:01.211423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:35:01.212573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:35:01.212857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:35:01.213130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:35:01.221949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:35:01.223372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ae1c7-af99-4ff5-8a03-d56e44b2a0c0 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:35:01.233386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 775/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:35:10.622721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=63 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:11.229301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=37 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:29.496296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.496958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.496958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.528326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:29.529577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:29.541096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 765/1540] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:29.549606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.550522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.550956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.576494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:29.577959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:29.596076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 776/1541] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:29.600872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:29.611946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1ba3c-26d9-4f1c-a6a5-e4f02a6bea1c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:29.623128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:29.624771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.625063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.625346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.626273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:29.626595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:29.628265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146b907-4cd0-474d-956d-de1fe195b2ad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:29.647858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 766/1542] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:29.656789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:29.666755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340e65-043c-42a9-ad71-a567c5275cbb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:29.679476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:29.680172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.680458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.680731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.681365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:29.683887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:29.837301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 777/1543] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:29 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:29.837662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57706-5035-4edc-aa58-2c3893ad2bb4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.837662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57706-5035-4edc-aa58-2c3893ad2bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.837997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57706-5035-4edc-aa58-2c3893ad2bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.846156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:29.876787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8ce57706-5035-4edc-aa58-2c3893ad2bb4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:29.877935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8ce57706-5035-4edc-aa58-2c3893ad2bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:29.951589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490b38-1fc0-421d-9293-bc082e8a999f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:29.963864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:29.964568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:29.965381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:29.966155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:29.966866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:29.967947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:29.967947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:36:29.967947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:36:29.969179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.039547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 767/1544] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.047556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.047844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.048133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.078020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 778/1545] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:29 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:36:30.084267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.084454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.085497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.099358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3847-d03a-47c1-866e-af803e403b74 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.101993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 768/1546] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:30.106986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.115969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.116610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.117439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.117439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.118006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.119686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.125985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5c64f-9b1b-47d1-8a9d-e97505170786 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.133337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 779/1547] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:36:30.139387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.144208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.144857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.145142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.145418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.146078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.146382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.148037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90900bb-c842-4a92-b3dd-8bb420f4c629 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.158031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36583845-9e29-4193-8047-ca600b3bf829 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.165692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.169823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.169823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.169823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.169823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.169823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.177953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 769/1548] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:36:30.179220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.179566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.179804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.188958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 780/1549] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:36:30.189812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.209382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0f2a-4368-4cf8-854d-3f20772f4e29 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.219791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.221347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.221347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.221347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.221601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.223447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b08e71-e7fc-466c-a3d5-ed35eac7ca49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.227984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.229209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.245586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 770/1550] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.246819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.261211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d84cc-2263-4c14-9002-4aeb5b55e1cb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.273023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.274051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.274560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.275060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] PATH_INFO: `/v3/projects/f78c790271514a5585db4efc1f691b2f/users/a0a1588ce02044c183ea0e2fea20e8e0/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.292742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78c790271514a5585db4efc1f691b2f, user_id=a0a1588ce02044c183ea0e2fea20e8e0, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.293826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:30.293826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:36:30.293826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:36:30.295973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9286724-51af-468b-b8fd-66b4187c8e71 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.343020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 781/1551] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:30.344692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eb4a-2323-4269-b64e-b4c88ddeef9f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.344992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eb4a-2323-4269-b64e-b4c88ddeef9f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.345266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eb4a-2323-4269-b64e-b4c88ddeef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.366912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f148eb4a-2323-4269-b64e-b4c88ddeef9f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.368148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f148eb4a-2323-4269-b64e-b4c88ddeef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.399229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 771/1552] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:30 2022] PUT /identity/v3/projects/f78c790271514a5585db4efc1f691b2f/users/a0a1588ce02044c183ea0e2fea20e8e0/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:30.400599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c1b4-f717-4a1b-b16b-15fe2a49d9ef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.401064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c1b4-f717-4a1b-b16b-15fe2a49d9ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.401393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c1b4-f717-4a1b-b16b-15fe2a49d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.421294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5b70c1b4-f717-4a1b-b16b-15fe2a49d9ef None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.422613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5b70c1b4-f717-4a1b-b16b-15fe2a49d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.430633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 782/1553] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.432065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9bc9-4bfc-482f-b2f3-69242352e4af None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.432723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9bc9-4bfc-482f-b2f3-69242352e4af None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.432723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e9bc9-4bfc-482f-b2f3-69242352e4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.452559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cc1e9bc9-4bfc-482f-b2f3-69242352e4af None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.453758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cc1e9bc9-4bfc-482f-b2f3-69242352e4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.458200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:30.485924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 772/1554] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.487453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655e59-aaa8-4353-873f-c9a4c3e755bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.487770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655e59-aaa8-4353-873f-c9a4c3e755bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.488103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655e59-aaa8-4353-873f-c9a4c3e755bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.508305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b9655e59-aaa8-4353-873f-c9a4c3e755bd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.509553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b9655e59-aaa8-4353-873f-c9a4c3e755bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.515007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 783/1555] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.516509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71782f-50c7-4192-9924-a3c3ba67c937 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.517072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71782f-50c7-4192-9924-a3c3ba67c937 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.517356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71782f-50c7-4192-9924-a3c3ba67c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.518691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 773/1556] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.520157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.520440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.520708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.540566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.541761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.545022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5a71782f-50c7-4192-9924-a3c3ba67c937 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.546176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5a71782f-50c7-4192-9924-a3c3ba67c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.550695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 774/1557] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.551592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.554412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 784/1558] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.555451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8a30-e4cc-48d1-b666-ffdfcdec5c55 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.555765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8a30-e4cc-48d1-b666-ffdfcdec5c55 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.556038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b8a30-e4cc-48d1-b666-ffdfcdec5c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.568728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009258de-9d1e-4d13-8459-d16f9b9c5045 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.573577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.574829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.575144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.575394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.575965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-793b8a30-e4cc-48d1-b666-ffdfcdec5c55 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.576071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.577154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-793b8a30-e4cc-48d1-b666-ffdfcdec5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.578009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fec290-aae4-4511-a618-9f178a6aba47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.584717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 785/1559] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.585960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.586243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.586513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.606144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.607320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.615249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 786/1560] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.616179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.625740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473f0d-cbdc-442b-a8a6-ad5514b79af8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.630490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.637135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.637135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.637135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.637135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.637135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.637614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:30.637614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:36:30.637614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:36:30.637614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bba445-224b-42f6-b2e7-353e20cd7de5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.646681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 787/1561] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:30.647963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b17b-8226-46d2-9146-6da290893a5d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.648157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b17b-8226-46d2-9146-6da290893a5d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.648444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b17b-8226-46d2-9146-6da290893a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.672642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e803b17b-8226-46d2-9146-6da290893a5d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.673801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e803b17b-8226-46d2-9146-6da290893a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.673923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:30.679130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 775/1562] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:30.683204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 788/1563] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.683858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a615-d0bb-4914-8025-0a87b17f8658 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.684149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a615-d0bb-4914-8025-0a87b17f8658 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.684425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84a615-d0bb-4914-8025-0a87b17f8658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.685088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.685497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.685776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.704757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0f84a615-d0bb-4914-8025-0a87b17f8658 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.705033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.705954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0f84a615-d0bb-4914-8025-0a87b17f8658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.706200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.713981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 776/1564] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.715997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.716389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.716473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.718508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 789/1565] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.719266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.737071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:30.738275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:30.750296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 777/1566] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:30.750296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.759877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8a9a-cd02-43b4-adf7-21de2fa9c6eb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.765534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.765662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.765922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.766191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.766829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.767131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.768758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.776050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a5cb1-49c7-4977-829e-d6da2091470b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.779862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.780252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 778/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:30.780477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.780767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.781026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.781135 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.791249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.792621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71497-27be-46b4-9a8f-516aa3f37a09 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.792946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.797500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.798120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.798407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.798678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.799326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.800353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:30.800353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:36:30.800353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:36:30.801716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.802708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 790/1568] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:30.803665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.813685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88db57-7f10-46cf-94ab-46e8e7272f71 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.818067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.818786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.819094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.819373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.820075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.821688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.832867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 791/1569] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:30.834309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.844406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b77b09-e965-4a07-be12-942664333339 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.848990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.849559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.849839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.850110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.850734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.851037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.852705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.864328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 792/1570] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:30.865097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.874777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1615181-e420-4dc3-9d73-98c6e896dbaf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.879211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.879864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.880144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.880414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.881029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.881356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.882955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.891121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 779/1571] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:30.892420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.902227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 793/1572] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:30.902227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.912127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7f976-f36c-4469-a1c4-70dd6231276e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.939452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:30.959719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fa68-3d6b-47f8-909f-30d60c8ba52a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:30.964907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.965865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.966553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.966553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.967041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.967350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.969007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.976013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:30.977375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:30.977375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:30.977586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:30.978127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:30.978487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:30.980439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:30.990067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 780/1573] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:30.990067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:30.997473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7efba-f58a-4fed-aa30-af11419a6a12 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.002361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.003750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.003750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.003750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.004511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.006607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.013633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 794/1574] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:31.014603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.027973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c90d-16ef-4405-9862-a36e42357e4b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.038238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.038238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.038238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.038238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.038742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.038742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.046760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 795/1575] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:31.047605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.056969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7b6d-3e2e-4d75-9eb0-7b44e4b2b519 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.062186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.062782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.063226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.063415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.064075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.065983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.181759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 781/1576] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:30 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.181759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.195873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 796/1577] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.195873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.267367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c95e5-820e-4293-88a7-e017b5a8f0db admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.272309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.272922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.273205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.273482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.274161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.276190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.276995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acd9c6-e3fc-40b1-8f10-babd70920e14 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.282849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.283608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.283895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.284478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.285123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.287157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.355431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 782/1578] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.355431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.364567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32d06-988e-4d87-b8f2-803ab4e7ca03 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.369238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.369835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.370119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.370395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.371020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.372988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.386247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:31.387816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 797/1579] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.390534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.454623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65f126-2880-4b1b-8281-61628fa0f77f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.460464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.461140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.461424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.461729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.462561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.465332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.516774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 783/1580] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.517268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.585116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8257-f7fa-4181-b1a1-ccedd7837542 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.589912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.590568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.590853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.591129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] PATH_INFO: `/v3/projects/dac7b34eeccd4aa883d1a0e092d748f1/users/df8e940b696f49caad14259027166a40/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.605153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac7b34eeccd4aa883d1a0e092d748f1, user_id=df8e940b696f49caad14259027166a40, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.608062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.608448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:31.614825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 798/1581] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.615644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.679523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405583d-3fcb-4663-9cc1-051b5d8c4f60 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.684735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.685381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.685670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.685951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.686587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.688566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.727778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 784/1582] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:31 2022] PUT /identity/v3/projects/dac7b34eeccd4aa883d1a0e092d748f1/users/df8e940b696f49caad14259027166a40/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:31.728603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.787145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 799/1583] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.788022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.798612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0590b-cc84-4828-8d37-254aad6c5d79 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.801761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864b5f7-de3c-4c14-93f7-36d2c46f01af admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.803985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.804247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.804591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.804879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.805623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.806772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.807422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.807558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.807865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.808785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.809833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.811898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.818727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 800/1584] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:31.819702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.830264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b737bcd-72b3-4a13-9f1f-3df523ba3468 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.834948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.835561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.835852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.836133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.836775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.838715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.904932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 785/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.905768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.915914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764befd-e8a1-4fe7-9540-47789b136592 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.922153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.922798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.923112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.923391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.924128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.926112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4bd6-28c0-41e3-adaf-922ce2c72aea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:31.967636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 801/1586] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:31.968501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:31.978074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc24abd-89e5-49c4-ba30-3449a40c4dd8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:31.983389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:31.983991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:31.984272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:31.984546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:31.985333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:31.987243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.029962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 786/1587] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:32.029962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9788-821b-4123-b028-8af48856921c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.029962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9788-821b-4123-b028-8af48856921c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.029962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9788-821b-4123-b028-8af48856921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.047974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a5c9788-821b-4123-b028-8af48856921c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:32.049166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a5c9788-821b-4123-b028-8af48856921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:32.060120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 787/1588] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:32.061176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9788-821b-4123-b028-8af48856921c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.070782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9788-821b-4123-b028-8af48856921c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.075681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.076300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.076635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.077026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.077666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.079255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.089289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 788/1589] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.090197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.099624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78adc-de16-48c3-abc5-854a09b40d4a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.104245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.104820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.105686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.106549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.107247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.108807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.113909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 802/1590] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:31 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:32.114774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.123730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 789/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.123730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.128054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34516ff-9015-42c7-b88b-f033e6d5fc8d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.131699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615be31-e3d1-4089-a2aa-a62c97fbbee1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.132870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.133470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.133747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.134019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.134661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.136322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.136595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.137736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.137920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.138197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.138839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.140440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.156859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 803/1592] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.157166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.168712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45016b8-50ab-4a80-be6e-832c5f244554 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.171536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 790/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.172539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.176049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.176915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.177344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.177862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.178792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.180651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.184564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:32.192615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 804/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.193424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.203795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dcb50-11b1-4975-a948-592249d8c052 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.209220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.209832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.210112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.210382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.211022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.213240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.225856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 805/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.226774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.242427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d7067-1716-4cae-a73b-d1d19433980f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.245200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39375e4c-d0bf-4e68-9163-160290542409 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.251692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.252082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.252717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.252998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.253325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.253444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.253929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.254049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.254552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.256171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.268000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.271592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 806/1596] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.271717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.271810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.281708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 791/1597] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:32.282793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.291730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1ea5-441b-456f-8f33-0a011232644b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.292989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd769f8-7901-4c04-a093-94a1a2832234 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.300537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.301277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.302351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.303053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.303854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.304141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.304443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.305320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.305673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] PATH_INFO: `/v3/projects/d5edb9fb13b44b7291d85d3b076bae67/users/e2d6c76ba6c34f219faf59f9dd1b1fea/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.308080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.326563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 792/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.326563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.328955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5edb9fb13b44b7291d85d3b076bae67, user_id=e2d6c76ba6c34f219faf59f9dd1b1fea, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.331995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.337412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116243e-472b-46c8-8c47-dadd2c1a24fd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.343251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.344530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.344530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.344907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.349659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.349659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.359653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 793/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.361709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.374805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56aee8-a824-42e8-9c8e-1cc8581bb42a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.379584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.380193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.380623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.380905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.381555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.383176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.396089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 794/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.401335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.413178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b7f2-0047-44c2-97e4-d9349e5124e4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.418869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.419726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.419852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.420144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] PATH_INFO: `/v3/projects/bf6982e156e846f7adfe00fbda7418e0/users/c6ed88668fa04f3f8b423af40e240557/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.439932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6982e156e846f7adfe00fbda7418e0, user_id=c6ed88668fa04f3f8b423af40e240557, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.442829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.465793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 807/1601] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/d5edb9fb13b44b7291d85d3b076bae67/users/e2d6c76ba6c34f219faf59f9dd1b1fea/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:32.465793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.512335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:32.530211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 795/1602] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/bf6982e156e846f7adfe00fbda7418e0/users/c6ed88668fa04f3f8b423af40e240557/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:32.533206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.552523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f147-76f0-4d7e-8752-17bb423cad44 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.619584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca9f8-8f68-4b6f-876b-de7d78c8eb96 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.625201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.625864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.626143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.626356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.626839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] PATH_INFO: `/v3/projects/b5ac9dbc2be04da694cb28638e11d058/users/06b40cbdea9d458c8f91aabd600f27d7/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.627158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.627425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.627690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.628341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.629973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.641369 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 808/1603] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:32.642630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.645864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ac9dbc2be04da694cb28638e11d058, user_id=06b40cbdea9d458c8f91aabd600f27d7, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.648824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.654194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d06e-4b9a-4093-9a75-86f10cb6de33 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.659596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.660253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.660665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.660957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] PATH_INFO: `/v3/projects/0e4b67180f864ca2a5650c60f794458f/users/0454f307b0344b26901218129a119fb3/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.676705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b67180f864ca2a5650c60f794458f, user_id=0454f307b0344b26901218129a119fb3, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.679737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b912e-1e75-4d3e-a4a9-810ca18f0ea9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.772122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 796/1604] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/b5ac9dbc2be04da694cb28638e11d058/users/06b40cbdea9d458c8f91aabd600f27d7/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:32.772531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.803998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 809/1605] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/0e4b67180f864ca2a5650c60f794458f/users/0454f307b0344b26901218129a119fb3/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:32.805316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718bbc-2c54-49e1-aa80-e437a22e6256 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.805601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718bbc-2c54-49e1-aa80-e437a22e6256 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.805873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9718bbc-2c54-49e1-aa80-e437a22e6256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.817675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:32.830742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c9718bbc-2c54-49e1-aa80-e437a22e6256 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:32.834846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c9718bbc-2c54-49e1-aa80-e437a22e6256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:32.850476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a854-b1d9-41a5-b364-679dcd23a28d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.906037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 810/1606] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:32.907555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.907983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.908262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.927790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.928704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.928829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:32.929171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.929552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] PATH_INFO: `/v3/projects/d761955f0a914ca9b745e1a1456aae3b/users/89b10d3e18344610b046ca6be234f816/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.929922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:32.941717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 811/1607] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:32.942765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:32.957380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d2cc1-aa57-45ea-b56f-c395e45f9b15 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:32.958733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d761955f0a914ca9b745e1a1456aae3b, user_id=89b10d3e18344610b046ca6be234f816, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.963828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf904-7be1-4241-b52f-6d2b5cfa85ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:32.964549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:32.965850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:32.966304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:32.966676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] PATH_INFO: `/v3/projects/d1cbb94191ee46e09a53e7b3f1130afe/users/67b50fb4e6664178a665d2e986859099/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:32.982247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cbb94191ee46e09a53e7b3f1130afe, user_id=67b50fb4e6664178a665d2e986859099, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:32.985071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f22421-cddb-4e33-bb85-ceae0ca7ba12 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.049128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 797/1608] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/d761955f0a914ca9b745e1a1456aae3b/users/89b10d3e18344610b046ca6be234f816/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:33.050573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.050862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.051134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.091645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] MFA Rules not processed for user `06b40cbdea9d458c8f91aabd600f27d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:33.093232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:33.115026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 812/1609] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:32 2022] PUT /identity/v3/projects/d1cbb94191ee46e09a53e7b3f1130afe/users/67b50fb4e6664178a665d2e986859099/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:33.117017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.117017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.117246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.158899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] MFA Rules not processed for user `0454f307b0344b26901218129a119fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:33.160633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:33.174671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:33.227999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 798/1610] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:33.228796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.263991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 813/1611] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:33.268261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.344406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f848977-f277-4bdb-a53f-786b5a548999 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:33.434475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:33.440731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6c9c-bae4-4b2a-a6a7-799540b89454 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:33.440731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:33.440731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.440731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.441155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.456772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:33.457491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.457842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.458123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.552996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:33.556187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8989b-acdc-4416-9d5a-a510f9e3c455 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.563736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:33.565215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3b134-c767-4c05-919d-6a354b8552a0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.570350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 799/1612] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:33.571934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356bfc8-103c-416e-b789-1680740b7031 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.572428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356bfc8-103c-416e-b789-1680740b7031 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.573300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356bfc8-103c-416e-b789-1680740b7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.584215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 814/1613] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:33.585405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.585698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.585977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.611679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:33.617500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:33.620527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1356bfc8-103c-416e-b789-1680740b7031 None None] MFA Rules not processed for user `89b10d3e18344610b046ca6be234f816`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:33.622732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1356bfc8-103c-416e-b789-1680740b7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:33.636907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 815/1614] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:33.638863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.654603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a00a5-666f-476f-a733-06f80b53a150 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:33.660686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:33.661439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.661827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.662244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.662966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:33.664998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb664f2-0e61-41a1-88de-4c3a3537a503 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.702938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 800/1615] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:33.704289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a512e4-c5a8-4c79-825d-6b47097102cd None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.704580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a512e4-c5a8-4c79-825d-6b47097102cd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.704851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a512e4-c5a8-4c79-825d-6b47097102cd None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.706247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 801/1616] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 16:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:33.707092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a512e4-c5a8-4c79-825d-6b47097102cd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.719072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a512e4-c5a8-4c79-825d-6b47097102cd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:33.723129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:33.723898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.724179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.724455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.733882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:33.735344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.746215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 802/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:33.746568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.755509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad8ccc-e030-4f1b-94d4-7f45c0edd430 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:33.767186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:33.767186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.767186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.767186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.767749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:33.767749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:33.803598 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 816/1618] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:33.807386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:33.807386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:33.807386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:33.853679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:33.855269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:33.880256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:33.909488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 803/1619] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:33.911528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:33.975141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 817/1620] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:33.976574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.026171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505338a-b2b0-436b-8fe5-187bf2253884 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.033288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.034887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.035302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.035612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.036614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.038878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.067215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8f1b-cdaa-410c-9114-c97270561c60 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.072039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.072663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.072956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.073233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.074542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.076637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.095805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:34.142255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 804/1621] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:34.143401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.222014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 818/1622] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:33 2022] POST /identity/v3/users => generated 308 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:34.223111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.257633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a34f7-98b9-4abb-b4ba-39cad936652e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.287204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.291094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.291393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.291699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.296674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.305150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.315808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ca32-5d01-4e1b-868b-c71f95bd5605 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.336141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.336837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.337278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.337567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.339029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 819/1623] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:34.340158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.366915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689571e9-923d-4e65-a97d-ddee3c413654 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.381967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.382919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.383398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.383790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.385622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.389995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.404445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.406149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.418769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 805/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:34.419683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.435695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 820/1625] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:34.442194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.442446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d8624-e893-472a-aa6a-bb2c8376aeb9 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.461883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.462577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.462917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.463657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] PATH_INFO: `/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6/users/495cc81635504b75b29488069f5ddc70/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.470529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0630-454b-4450-b2a7-d1aaee5877e5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.476542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.477440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.477726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.479882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] PATH_INFO: `/v3/projects/62a5d4744708467a82c047ea89f2aa93/users/510afd3abdc34949bf49cc978e8890fa/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.497111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a5d4744708467a82c047ea89f2aa93, user_id=510afd3abdc34949bf49cc978e8890fa, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.497347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cae2bd0ca741d5ab70f37d04998fd6, user_id=495cc81635504b75b29488069f5ddc70, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.500079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.500222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1e5d-2ae0-46cf-935b-f7d079986644 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.626766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 821/1626] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:34 2022] PUT /identity/v3/projects/62a5d4744708467a82c047ea89f2aa93/users/510afd3abdc34949bf49cc978e8890fa/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:34.626766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.626766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.626766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.651070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 806/1627] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:34 2022] PUT /identity/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6/users/495cc81635504b75b29488069f5ddc70/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:34.652588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.705817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] MFA Rules not processed for user `df8e940b696f49caad14259027166a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:34.715909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:34.773476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad35e3-0e9e-42df-b6f2-35f7dca74edf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.783940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.786790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.786790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.786790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.787804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.790108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.808613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 807/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:34.809554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.812721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:34.824975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a9e7-fe15-4c42-bfbe-e94a003d0ea6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.830588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.831430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.831882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.832161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.832964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.835800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.856005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 808/1629] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:34.857036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.857758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 822/1630] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:34.859137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.869291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d97a39-0ae5-4c44-83df-e787390ae91a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.876974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.877724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.878255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.879686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] PATH_INFO: `/v3/projects/62a5d4744708467a82c047ea89f2aa93/users/510afd3abdc34949bf49cc978e8890fa/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.882812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a5d4744708467a82c047ea89f2aa93, user_id=510afd3abdc34949bf49cc978e8890fa, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.885378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed0b4-744c-42a0-8b1e-660ad7794d99 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:34.885700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.895628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:34.896307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.896625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.896961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] PATH_INFO: `/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6/users/495cc81635504b75b29488069f5ddc70/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.899892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cae2bd0ca741d5ab70f37d04998fd6, user_id=495cc81635504b75b29488069f5ddc70, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:34.909905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 809/1631] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:34 2022] PUT /identity/v3/projects/62a5d4744708467a82c047ea89f2aa93/users/510afd3abdc34949bf49cc978e8890fa/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:34.909905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:34.919871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427a49b-f5db-42dd-b250-5678114e5314 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:34.934736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 823/1632] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:34 2022] PUT /identity/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6/users/495cc81635504b75b29488069f5ddc70/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:34.936117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f43a5a-6587-452d-ab27-c66d6aa38771 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:34.936406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f43a5a-6587-452d-ab27-c66d6aa38771 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:34.936681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f43a5a-6587-452d-ab27-c66d6aa38771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:34.982292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-90f43a5a-6587-452d-ab27-c66d6aa38771 None None] MFA Rules not processed for user `510afd3abdc34949bf49cc978e8890fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:34.982636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:34.983609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-90f43a5a-6587-452d-ab27-c66d6aa38771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:35.025130 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35dab-ecc8-441e-8f37-49b606c81bd4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.095791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 824/1633] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:35.095791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44308-0f04-44df-88cc-ae38841c8fcd None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.095791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44308-0f04-44df-88cc-ae38841c8fcd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.099608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e44308-0f04-44df-88cc-ae38841c8fcd None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.101363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 825/1634] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 16:36:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:35.109360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.114054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.114054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.114251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ba6-6bfe-49d7-8542-0d70db902783 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.114351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.114439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ba6-6bfe-49d7-8542-0d70db902783 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.114439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ba6-6bfe-49d7-8542-0d70db902783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.114576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.114576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.151184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e7734ba6-6bfe-49d7-8542-0d70db902783 None None] MFA Rules not processed for user `495cc81635504b75b29488069f5ddc70`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:35.154540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e7734ba6-6bfe-49d7-8542-0d70db902783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:35.259175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 826/1635] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:35.261868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.262134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.262463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.281229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 810/1636] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:34 2022] POST /identity/v3/projects => generated 403 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:35.282752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.311686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:35.313311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:35.432350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754008b-19be-4170-8852-4f6a24f09bc0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.440282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.441044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.441462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.442163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.455550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 827/1637] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:35.456521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.467809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbabc70-d72d-4270-9b44-7c2f2763db7b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.477055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.477699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.478451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.478746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.551191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.554759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.576133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 811/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:35.579308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.909025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.909025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.909025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 828/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:35.909025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.920299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437fc0-e4c7-41dd-892f-94992aecffe2 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.924468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb07aa-8fde-4bdd-aff8-607518cbb071 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.924468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.927993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.930763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.931213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.935011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.935011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.939029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.939029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.939029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.939029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.940437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.940437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.940437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 829/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:35.941107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 812/1641] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:35 2022] POST /identity/v3/users => generated 308 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:35.941892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.941892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31ca41-00f6-44ee-970d-7fb1504ac6ec service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.942663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.943576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.943576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.943886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:35.947174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:35.948978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:35.966246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:35.967265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 830/1642] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:35.977124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e473e-3ebb-486f-b24a-f6d6b57622a6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:35.984031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:35.984720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:35.985003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:35.985282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] PATH_INFO: `/v3/projects/eb2c3007545241e4bc31d23a4bd8efef/users/32123f236e6146a58b4166539220fe56/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:36.022241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c3007545241e4bc31d23a4bd8efef, user_id=32123f236e6146a58b4166539220fe56, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:36.026123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:36.174292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 813/1643] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:35 2022] PUT /identity/v3/projects/eb2c3007545241e4bc31d23a4bd8efef/users/32123f236e6146a58b4166539220fe56/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:36.178510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:36.221852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ce4fd-d37b-481a-86d0-53fe00e182d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:36.311957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:36.332946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:36.333678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:36.334068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:36.335015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:36.336316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:36.338362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:36.378663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 831/1644] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:36.379620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:36.385425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:36.404453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ba1f2-6613-4676-8e4b-aa7f0c412bcf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:36.417966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:36.418728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:36.420550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:36.422001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] PATH_INFO: `/v3/projects/eb2c3007545241e4bc31d23a4bd8efef/users/32123f236e6146a58b4166539220fe56/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:36.425175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c3007545241e4bc31d23a4bd8efef, user_id=32123f236e6146a58b4166539220fe56, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:36.427890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:36.448233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c773b1-9191-4413-b3bc-6ddee6da6835 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:36.462166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 832/1645] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:36 2022] PUT /identity/v3/projects/eb2c3007545241e4bc31d23a4bd8efef/users/32123f236e6146a58b4166539220fe56/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:36.476139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:36.550096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:36.550795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:36.551196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:36.551361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:36.669641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:36.671594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b759f5-cd14-4425-b4d2-a71b53e529ff service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:36.683909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 814/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:37.098811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:37.300713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef19b-8108-4266-9459-36147efccfc4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:37.320968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:37.321646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:37.321936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:37.322242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] PATH_INFO: `/v3/users/89b10d3e18344610b046ca6be234f816` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:37.325175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b10d3e18344610b046ca6be234f816)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:37.327145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:37.626333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b10d3e18344610b046ca6be234f816'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:37.643152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b10d3e18344610b046ca6be234f816'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:37.645406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b10d3e18344610b046ca6be234f816'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:37.674688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b10d3e18344610b046ca6be234f816'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:37.676330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7f5fa2e3-ed02-45ad-97d4-3121ffff5155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b10d3e18344610b046ca6be234f816'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:37.774902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 833/1647] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:37 2022] DELETE /identity/v3/users/89b10d3e18344610b046ca6be234f816 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:37.779328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:37.780446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:37.780734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:37.794566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb7e5-831c-4ace-a2bb-9368cdc0136b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:37.794878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb7e5-831c-4ace-a2bb-9368cdc0136b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:37.795336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb7e5-831c-4ace-a2bb-9368cdc0136b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:37.798831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 834/1648] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 16:36:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:36:37.807899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19e0b-2159-4a6f-b031-0a460827b98f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:37.808906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19e0b-2159-4a6f-b031-0a460827b98f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:37.809300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae19e0b-2159-4a6f-b031-0a460827b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:37.827312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:37.828645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:37.855727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dae19e0b-2159-4a6f-b031-0a460827b98f None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:37.857041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dae19e0b-2159-4a6f-b031-0a460827b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:37.990405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 815/1649] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:38.004199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:38.005177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:38.006683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:38.017343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 835/1650] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:38.029322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb57-7ec5-4d1b-81ab-74ddc8cecf75 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:38.029322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb57-7ec5-4d1b-81ab-74ddc8cecf75 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:38.029568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306eb57-7ec5-4d1b-81ab-74ddc8cecf75 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:38.032638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 836/1651] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 16:36:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:38.040483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:38.041671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:38.041965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:38.046977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:38.103458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:38.107584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:38.130394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c06012-a25f-41b6-b6a3-d9b1818abec8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:38.135023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 837/1652] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:38.153378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:38.155122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:38.155437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:38.156773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:38.157379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:38.158054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:38.173218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:38.175629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:38.192039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 816/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:38.240584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6103f8-9b3b-4884-a339-22e3c7a30c6c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:38.245977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:38.246792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:38.247196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:38.247648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:38.271570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:38.271570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:38.290596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 838/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:39.643591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:39.700157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:40.295462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:40.297145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:40.343295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7934ed-034c-48ea-82ec-722bf1b4ad20 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:40.357562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:40.358540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:40.359341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:40.359827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] PATH_INFO: `/v3/projects/d761955f0a914ca9b745e1a1456aae3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:40.362045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d761955f0a914ca9b745e1a1456aae3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:40.364129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:40.517723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd761955f0a914ca9b745e1a1456aae3b', 'request_id': 'req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:40.524234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd761955f0a914ca9b745e1a1456aae3b', 'request_id': 'req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:40.593726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd761955f0a914ca9b745e1a1456aae3b', 'request_id': 'req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:40.612317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] The token cache is being invalidate because project d761955f0a914ca9b745e1a1456aae3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:40.613393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:40.614194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dbd8c007-0aeb-4e21-99b8-f0c3f54948ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:40.619978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 817/1655] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:40 2022] DELETE /identity/v3/projects/d761955f0a914ca9b745e1a1456aae3b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:40.621070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:40.634713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc719-0476-4903-9881-22466ec36c1c service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:40.713356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb43c-0456-4f27-a34a-39d7550f33bf None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:40.713356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb43c-0456-4f27-a34a-39d7550f33bf None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:40.713932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb43c-0456-4f27-a34a-39d7550f33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:40.771065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:40.772461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:40.779148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:40.779936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] PATH_INFO: `/v3/users/510afd3abdc34949bf49cc978e8890fa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:40.782257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=510afd3abdc34949bf49cc978e8890fa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:40.785020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:40.877404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a5ebb43c-0456-4f27-a34a-39d7550f33bf None None] MFA Rules not processed for user `32123f236e6146a58b4166539220fe56`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:40.877404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a5ebb43c-0456-4f27-a34a-39d7550f33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:41.024422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 818/1656] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:41.170215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510afd3abdc34949bf49cc978e8890fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:41.184961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510afd3abdc34949bf49cc978e8890fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:41.190688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510afd3abdc34949bf49cc978e8890fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:41.209892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510afd3abdc34949bf49cc978e8890fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:41.211150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510afd3abdc34949bf49cc978e8890fa'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:41.361759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 839/1657] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:40 2022] DELETE /identity/v3/users/510afd3abdc34949bf49cc978e8890fa => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:41.648121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01201afc-b8ed-4eb0-8cde-cf0c1c68d2db None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:41.648564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01201afc-b8ed-4eb0-8cde-cf0c1c68d2db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:41.648842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01201afc-b8ed-4eb0-8cde-cf0c1c68d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:41.737574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-01201afc-b8ed-4eb0-8cde-cf0c1c68d2db None None] MFA Rules not processed for user `a0a1588ce02044c183ea0e2fea20e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:41.742763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01201afc-b8ed-4eb0-8cde-cf0c1c68d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:41.859426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:41.906833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 819/1658] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:41.921154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:41.926622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:42.107284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a338-b75b-46f6-ada3-1c3a764fbedb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:42.128927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:42.130521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:42.130801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:42.131090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:42.169289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:42.171938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dbafb-b947-4259-a018-73ad6ecde870 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:42.205817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 840/1659] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:42.296224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:43.074565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.075191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.075191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.076585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 820/1660] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:43.125331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dce51-a3fc-4491-9ed7-8878ae408efc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.125877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dce51-a3fc-4491-9ed7-8878ae408efc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.125877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dce51-a3fc-4491-9ed7-8878ae408efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.189365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f70dce51-a3fc-4491-9ed7-8878ae408efc None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:43.194077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f70dce51-a3fc-4491-9ed7-8878ae408efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:43.302019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:43.304167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:43.362953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 841/1661] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:43.402748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a18df-b8a5-4912-827e-870531cd5511 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.403038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a18df-b8a5-4912-827e-870531cd5511 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.403318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a18df-b8a5-4912-827e-870531cd5511 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.405047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 842/1662] 10.222.0.43 () {54 vars in 961 bytes} [Fri Aug 19 16:36:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:36:43.413975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.413975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.413975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.419562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18226f7-335d-474a-9f21-3dafbbf6e765 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:43.425631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:43.426524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.426958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.427726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] PATH_INFO: `/v3/projects/62a5d4744708467a82c047ea89f2aa93` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.429086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a5d4744708467a82c047ea89f2aa93)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:43.432085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:43.461740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:43.473162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:43.503796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 843/1663] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Aug 19 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:43.515608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:43.533938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a618-eeb8-499e-b003-db231db75b73 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:43.541943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:43.542919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.543252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.543576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.553788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:43.559828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e88c-204c-4baa-ae93-1b6f3b59e433 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:43.569059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 844/1664] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:43.583810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a5d4744708467a82c047ea89f2aa93', 'request_id': 'req-fd24e85b-012f-497c-961e-484ff0bcb4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:43.600960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a5d4744708467a82c047ea89f2aa93', 'request_id': 'req-fd24e85b-012f-497c-961e-484ff0bcb4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:43.713248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a5d4744708467a82c047ea89f2aa93', 'request_id': 'req-fd24e85b-012f-497c-961e-484ff0bcb4e4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:43.738373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] The token cache is being invalidate because project 62a5d4744708467a82c047ea89f2aa93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:43.738594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:43.740640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-fd24e85b-012f-497c-961e-484ff0bcb4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:43.746712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 821/1665] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:43 2022] DELETE /identity/v3/projects/62a5d4744708467a82c047ea89f2aa93 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:43.750911 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.751245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.751438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.791929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:43.793241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:43.943529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 845/1666] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:43.952642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:43.952642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:43.952642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:43.990171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:43.991558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:44.006059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.013350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 822/1667] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:44.024922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387ef5f-4ae6-49f4-8722-a8de265df7c0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.031736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.032414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.032703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.033038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.033677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:44.034234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.036150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.062972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 846/1668] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:44.066269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.077419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dad41e-fb8e-4a97-b7a2-c11a44279817 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.084926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.085772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.086088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.086374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.087029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.089754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.226416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 823/1669] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:44 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:44.233401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.248646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b6-dc91-47f1-ae0c-4f5a42bb65ef admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.361603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:44.400549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.401182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.401467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.402272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.402919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.405095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.541958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.548726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 847/1670] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:44 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:44.560247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc492a4-ffef-4591-8ca7-4308fe9a17a9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.570914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.576834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.576834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.576834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.576834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.576834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.587422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 824/1671] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:36:44.592065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.606390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d3fc-0ead-49ce-a369-976651e9ecfb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.624060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.624697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.625139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.625571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.626388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.628233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa1c5-7424-41dc-bd7e-d449ab6a1024 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.650929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 848/1672] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:44.656031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:44.684478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e000-ed9d-4693-a7a6-5770688d5d8a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:44.702747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:44.703552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.703869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.704154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] PATH_INFO: `/v3/projects/b8052c93240b42c7a06882eeddcd7b23/users/5d92aa2cca92456a9b2a5101c89de975/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.729025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8052c93240b42c7a06882eeddcd7b23, user_id=5d92aa2cca92456a9b2a5101c89de975, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:44.732501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:44.815772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 825/1673] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:44 2022] PUT /identity/v3/projects/b8052c93240b42c7a06882eeddcd7b23/users/5d92aa2cca92456a9b2a5101c89de975/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:44.830062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:44.830062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:44.830062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:44.912280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] MFA Rules not processed for user `5d92aa2cca92456a9b2a5101c89de975`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:44.913521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:45.081185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 849/1674] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:45.085523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:45.149605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:45.266212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf738-1351-4db0-aae7-575279c03d80 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:45.277227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:45.277870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.278155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.278432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:45.279116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:45.286484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:45.305268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:45.308893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:45.341082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1e108-86a9-43a1-b2a8-81cff2f02b95 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:45.346301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:45.347229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.347742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.348721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] PATH_INFO: `/v3/users/06b40cbdea9d458c8f91aabd600f27d7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:45.350942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b40cbdea9d458c8f91aabd600f27d7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:45.353501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:45.429318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 826/1675] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:45.430278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:45.532739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd067-66a8-4fee-88c9-b4347d393d84 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:45.539600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:45.543100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.543100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.543100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:45.543100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:45.544385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:45.587361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b40cbdea9d458c8f91aabd600f27d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:45.600754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b40cbdea9d458c8f91aabd600f27d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:45.602604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b40cbdea9d458c8f91aabd600f27d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:45.659537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b40cbdea9d458c8f91aabd600f27d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:45.660508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7ab4a07a-1d28-4b25-97a6-db67ac0d0c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b40cbdea9d458c8f91aabd600f27d7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:45.662325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 827/1676] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:45 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:45.667751 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:45.670566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:45.706325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf7f-d00c-48a6-8a40-ef996da5a350 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:45.722537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:45.723645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.724146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.724668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:45.726037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:45.728053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:45.758607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 850/1677] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:45 2022] DELETE /identity/v3/users/06b40cbdea9d458c8f91aabd600f27d7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:45.767340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.767340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.767340 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:45.767690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 828/1678] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:36:45.791159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:45.807169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:45.811036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:45.825495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187c576-0ea6-4076-befe-72f15cec4077 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:45.859373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:45.957192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 851/1679] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:45.969588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:45.970752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:45.970752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:45.971142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] PATH_INFO: `/v3/projects/f8377d55016f4067bf2333df17e16573/users/9547a10843014c65897b4d54d04c307d/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.005905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:46.007677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:46.011268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8377d55016f4067bf2333df17e16573, user_id=9547a10843014c65897b4d54d04c307d, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:46.015231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:46.130837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 829/1680] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:45 2022] PUT /identity/v3/projects/f8377d55016f4067bf2333df17e16573/users/9547a10843014c65897b4d54d04c307d/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:46.134563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:46.179880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ca89e-4160-403c-9d94-8a862f33941d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:46.335573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3f99-661b-4726-9318-fa13695a7a7b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:46.353248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:46.354255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.354761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.356061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.364527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:46.365198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:46.365198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.365198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.365198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.365997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:46.383745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:46.390232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75faff-fa15-4e95-b43f-c957b5bcd91e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:46.392427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 830/1681] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:36:46.395563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:46.407258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 852/1682] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:46.419473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42e84-c258-4600-8309-b562e3120c7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:46.432279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:46.433327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.433768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.434210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] PATH_INFO: `/v3/projects/f8377d55016f4067bf2333df17e16573/users/9547a10843014c65897b4d54d04c307d/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.441734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8377d55016f4067bf2333df17e16573, user_id=9547a10843014c65897b4d54d04c307d, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:46.445883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:46.466730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 831/1683] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:46 2022] PUT /identity/v3/projects/f8377d55016f4067bf2333df17e16573/users/9547a10843014c65897b4d54d04c307d/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:46.478515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1cb1-b83c-4fd7-bd56-30f3f31f7de3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.479108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1cb1-b83c-4fd7-bd56-30f3f31f7de3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.479984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1cb1-b83c-4fd7-bd56-30f3f31f7de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.549296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8a6d1cb1-b83c-4fd7-bd56-30f3f31f7de3 None None] MFA Rules not processed for user `9547a10843014c65897b4d54d04c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:46.551356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8a6d1cb1-b83c-4fd7-bd56-30f3f31f7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:46.739142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 853/1684] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:46.750762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:46.751430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:46.773669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9eb6-edf4-4d99-8882-52235dbbc23d None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.774328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9eb6-edf4-4d99-8882-52235dbbc23d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.774781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9eb6-edf4-4d99-8882-52235dbbc23d None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.784509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 854/1685] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:36:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:46.832956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.833252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.833533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.883164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] MFA Rules not processed for user `3a7176bf626d4d8283c13da32f788c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:46.889130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:46.932376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5c8b-1730-49b0-be96-c6a3ae6a8e2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:46.959850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:46.959850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:46.959850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:46.959850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:46.960167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:47.058474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 855/1686] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:47.089968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:47.092908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:47.100741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:47.120289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0e3f-05d3-44fc-80f3-8221aba20a8a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:47.132190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:47.133011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:47.133449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:47.133894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:47.150994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:47.153183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:47.160177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:47.161933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:47.180342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 832/1687] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:47.181306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 856/1688] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:47.273889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:47.275652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:47.459578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:47.475076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155916-876a-4d4b-a89b-d94926d9ae59 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:47.488495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:47.489174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:47.489500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:47.489811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] PATH_INFO: `/v3/users/df8e940b696f49caad14259027166a40` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:47.502103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8e940b696f49caad14259027166a40)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:47.503297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: WARNING py.warnings [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:47.503297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: warnings.warn(msg) Aug 19 16:36:47.503297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: Aug 19 16:36:47.507002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:48.158517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8e940b696f49caad14259027166a40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:48.162311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8e940b696f49caad14259027166a40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:48.203747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8e940b696f49caad14259027166a40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:48.264224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8e940b696f49caad14259027166a40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:48.375773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8e940b696f49caad14259027166a40'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:48.388947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 833/1689] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:47 2022] DELETE /identity/v3/users/df8e940b696f49caad14259027166a40 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:48.490469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:49.312055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:49.317415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:49.363926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e2d5-4173-4446-a697-52549df59cb9 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:49.535941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:49.537243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:49.540382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:49.540382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] PATH_INFO: `/v3/projects/b5ac9dbc2be04da694cb28638e11d058` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:49.543361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ac9dbc2be04da694cb28638e11d058)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:49.546790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: WARNING py.warnings [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:36:49.546790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: warnings.warn(msg) Aug 19 16:36:49.546790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: Aug 19 16:36:49.548766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:49.733529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:49.735545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:49.823942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ac9dbc2be04da694cb28638e11d058', 'request_id': 'req-0c2639fa-8f4a-462a-b845-081a7a005a13'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:49.843564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ac9dbc2be04da694cb28638e11d058', 'request_id': 'req-0c2639fa-8f4a-462a-b845-081a7a005a13'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:49.879811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634983e-fc7f-4507-aae6-a68cc96df0c6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:49.972997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ac9dbc2be04da694cb28638e11d058', 'request_id': 'req-0c2639fa-8f4a-462a-b845-081a7a005a13'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.022707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] The token cache is being invalidate because project b5ac9dbc2be04da694cb28638e11d058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:50.023006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.030724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0c2639fa-8f4a-462a-b845-081a7a005a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.037215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 857/1690] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:49 2022] DELETE /identity/v3/projects/b5ac9dbc2be04da694cb28638e11d058 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:50.041810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278286d-8368-4727-901f-2e456d980245 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.042450 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278286d-8368-4727-901f-2e456d980245 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.042780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278286d-8368-4727-901f-2e456d980245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.068999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:50.070039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.070566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.071058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.079396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.082563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b278286d-8368-4727-901f-2e456d980245 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:50.083817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b278286d-8368-4727-901f-2e456d980245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.130077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:50.148170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:50.250009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:50.255280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 858/1691] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:50.256402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278286d-8368-4727-901f-2e456d980245 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:50.257277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df519a36-5203-4b5e-814a-dca8646b0840 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:50.265101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b278286d-8368-4727-901f-2e456d980245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.295790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 834/1692] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:50.303054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.303054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.303054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.314378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278286d-8368-4727-901f-2e456d980245 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:50.331815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:50.337553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.339762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.340641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] PATH_INFO: `/v3/projects/dac7b34eeccd4aa883d1a0e092d748f1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.346439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac7b34eeccd4aa883d1a0e092d748f1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:50.355466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:50.382491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:50.385044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.418267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 835/1693] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:50.430859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:50.457802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69659a-3c4f-406f-b088-2fe688854dad None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:50.474310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:50.475102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.475559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.476508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.478369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:50.480705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:50.484980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebe299-1f64-4cb5-b2aa-cf19689ff16a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:50.538501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 836/1694] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:36:50.538501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96879e58-8f4e-4f2c-97d2-1e6b2fbe6ec1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.538501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96879e58-8f4e-4f2c-97d2-1e6b2fbe6ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.538501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96879e58-8f4e-4f2c-97d2-1e6b2fbe6ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.620539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac7b34eeccd4aa883d1a0e092d748f1', 'request_id': 'req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.628104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-96879e58-8f4e-4f2c-97d2-1e6b2fbe6ec1 None None] MFA Rules not processed for user `c6ed88668fa04f3f8b423af40e240557`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:50.641880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-96879e58-8f4e-4f2c-97d2-1e6b2fbe6ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.645106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac7b34eeccd4aa883d1a0e092d748f1', 'request_id': 'req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.746906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac7b34eeccd4aa883d1a0e092d748f1', 'request_id': 'req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.759800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] The token cache is being invalidate because project dac7b34eeccd4aa883d1a0e092d748f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:50.760094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.763270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:50.767920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 859/1695] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:50 2022] DELETE /identity/v3/projects/dac7b34eeccd4aa883d1a0e092d748f1 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:50.769933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:50.770112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 837/1696] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:50.770848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.785604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.785891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.786234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.836748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] MFA Rules not processed for user `a0a1588ce02044c183ea0e2fea20e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:50.838309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.965997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 838/1697] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:50.974951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb4f6-e6d8-47b5-aa9c-50187fff8e7c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:50.986774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:50.987304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:50.989013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:50.989303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:50.989947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:50.991839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:50.992538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:50.998772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:51.010050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eff487-0cfd-451c-812c-6150bcebd76f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:51.018200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:51.025199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:51.025199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:51.025199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] PATH_INFO: `/v3/users/32123f236e6146a58b4166539220fe56` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:51.025199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32123f236e6146a58b4166539220fe56)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:51.025199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:51.179445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 860/1698] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:50 2022] POST /identity/v3/projects => generated 379 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:51.180407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:51.184658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:51.307331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32123f236e6146a58b4166539220fe56'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:51.309752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32123f236e6146a58b4166539220fe56'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:51.344880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32123f236e6146a58b4166539220fe56'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:51.378762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32123f236e6146a58b4166539220fe56'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:51.409303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae172-766a-4b87-aff3-68deaa3e24e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:51.419264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:51.421574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:51.421574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:51.421574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:51.424724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:51.442142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-bf25401c-07d2-4859-85a9-f97401bdf6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32123f236e6146a58b4166539220fe56'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:51.452189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 839/1699] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:50 2022] DELETE /identity/v3/users/32123f236e6146a58b4166539220fe56 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:51.453529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e652f9-349d-4eb2-93d0-210930e33d85 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:51.453923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e652f9-349d-4eb2-93d0-210930e33d85 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:51.454583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e652f9-349d-4eb2-93d0-210930e33d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:51.496784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-72e652f9-349d-4eb2-93d0-210930e33d85 None None] MFA Rules not processed for user `e2d6c76ba6c34f219faf59f9dd1b1fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:51.498168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72e652f9-349d-4eb2-93d0-210930e33d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:51.609148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:51.613334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:51.641114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 861/1700] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:51.642156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:51.753928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17f871-40af-4c7b-9a1d-e1735dcbed4c service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:51.764682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 840/1701] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:51.779545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:51.779545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:51.779545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:51.824989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:51.826257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:51.826544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:51.826820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:51.827467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:51.835601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:51.842774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] MFA Rules not processed for user `e2d6c76ba6c34f219faf59f9dd1b1fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:51.845495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:51.877078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 841/1702] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:51.961222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 862/1703] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:51 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:51.967897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:51.969294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:51.996776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a973a-5d11-4150-9e1e-0cb835c551e0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:51.999706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:52.002279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.027722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:52.028357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.028653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.031835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.032562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:52.038227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:52.039781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b14492-ca32-4b33-acff-932781eb0e84 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:52.055101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:52.055912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.057529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.058104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] PATH_INFO: `/v3/projects/eb2c3007545241e4bc31d23a4bd8efef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.061005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2c3007545241e4bc31d23a4bd8efef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:52.062996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:52.071073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 842/1704] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:52.071313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:52.075529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.097474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:52.217075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:52.399525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2c3007545241e4bc31d23a4bd8efef', 'request_id': 'req-541f2a40-8d8d-4ba7-a0f4-00658668e237'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:52.404454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef96d-763d-4569-a62f-748fb058043c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:52.419982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2c3007545241e4bc31d23a4bd8efef', 'request_id': 'req-541f2a40-8d8d-4ba7-a0f4-00658668e237'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:52.506735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2c3007545241e4bc31d23a4bd8efef', 'request_id': 'req-541f2a40-8d8d-4ba7-a0f4-00658668e237'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:52.526473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] The token cache is being invalidate because project eb2c3007545241e4bc31d23a4bd8efef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:52.527859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:52.529044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:52.532375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 863/1705] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:51 2022] DELETE /identity/v3/projects/eb2c3007545241e4bc31d23a4bd8efef => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:52.535099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:52.540403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.608645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:52.609296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.609583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.609860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.613520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.691405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f2a40-8d8d-4ba7-a0f4-00658668e237 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:52.710513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:52.710513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.710513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.710513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.710926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:52.710926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fad6ea-77d4-4d0f-ab30-18f4a3b2e3af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:52.724958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:52.726556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 864/1706] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:52.728073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b15bd-9996-4acc-8899-275a17031dfb None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.728361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b15bd-9996-4acc-8899-275a17031dfb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.728643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b15bd-9996-4acc-8899-275a17031dfb None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.729094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:52.730342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 865/1707] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 16:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:52.731818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca855d-9191-44cf-9afb-7ce7be5ed031 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.732564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca855d-9191-44cf-9afb-7ce7be5ed031 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.732845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca855d-9191-44cf-9afb-7ce7be5ed031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.774264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 843/1708] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:52.775746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:52.793356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ccca855d-9191-44cf-9afb-7ce7be5ed031 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:52.797275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ccca855d-9191-44cf-9afb-7ce7be5ed031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.802321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0036f-a271-497e-b05c-21ce1f415232 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:52.808902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:52.809598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.809888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.810172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] PATH_INFO: `/v3/projects/46970ba7d45740589534b8a9fa9acab6/users/3e8750b060bf449d8984121398748caf/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.815136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 866/1709] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:52.817058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03dbe-9f10-4ea4-a8d1-b4c86d2c9df5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.817363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03dbe-9f10-4ea4-a8d1-b4c86d2c9df5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.817642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03dbe-9f10-4ea4-a8d1-b4c86d2c9df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:52.845628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46970ba7d45740589534b8a9fa9acab6, user_id=3e8750b060bf449d8984121398748caf, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:52.848475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7f9a-64f0-4021-a229-1f78258d63b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:52.913230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b8b03dbe-9f10-4ea4-a8d1-b4c86d2c9df5 None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:52.921522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8b03dbe-9f10-4ea4-a8d1-b4c86d2c9df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:52.980962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 844/1710] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:52 2022] PUT /identity/v3/projects/46970ba7d45740589534b8a9fa9acab6/users/3e8750b060bf449d8984121398748caf/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:52.982389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaed9-07d2-4593-a8bd-f18aebe27c1b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:52.982682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaed9-07d2-4593-a8bd-f18aebe27c1b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:52.982960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaed9-07d2-4593-a8bd-f18aebe27c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.027588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b3bcaed9-07d2-4593-a8bd-f18aebe27c1b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:53.030667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b3bcaed9-07d2-4593-a8bd-f18aebe27c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.116415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 867/1711] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.116415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.116415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.116415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.214839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] MFA Rules not processed for user `67b50fb4e6664178a665d2e986859099`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:53.216382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.236360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 845/1712] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.237705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.243680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.244490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.294894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] MFA Rules not processed for user `3e8750b060bf449d8984121398748caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:53.295949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.406506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 868/1713] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.408493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:53.414822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.507372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 846/1714] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.512292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:53.540328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83f91-d025-49f7-aea0-0c569ce1fd78 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:53.542604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590b51-9018-4d09-bb09-22d7ea8e8e12 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:53.552784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:53.554803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.555101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.555542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.556471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:53.557114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.557404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.559696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.565949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:53.565949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:53.566680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:53.566977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:53.569143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7367-4062-4337-90f9-b8804197e423 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:53.581047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 869/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:53.596050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb0d-f7c9-4fd9-97d2-9971a6525d99 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.596552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb0d-f7c9-4fd9-97d2-9971a6525d99 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.596930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb0d-f7c9-4fd9-97d2-9971a6525d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.598321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 847/1716] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:53.599994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:53.632788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9381-a6f6-4a69-b781-453ef812e4be admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:53.640230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:53.640936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.641225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.641567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.642227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:53.644230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c7ad0-8a80-450c-a261-6d324dc4bd14 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:53.655652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a379cb0d-f7c9-4fd9-97d2-9971a6525d99 None None] MFA Rules not processed for user `67b50fb4e6664178a665d2e986859099`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:53.660472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a379cb0d-f7c9-4fd9-97d2-9971a6525d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.685816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 870/1717] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.685816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdc3a-6790-4124-8c10-11329375bcc3 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.685816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdc3a-6790-4124-8c10-11329375bcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.685816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cdc3a-6790-4124-8c10-11329375bcc3 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.693802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 871/1718] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 16:36:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:36:53.696106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cdc3a-6790-4124-8c10-11329375bcc3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:53.713818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cdc3a-6790-4124-8c10-11329375bcc3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:53.746054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:53.746878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.747240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.749604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.750638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:53.755694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:53.797574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 848/1719] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:53.797574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756042d-2524-414a-a233-b2aad7444132 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:53.798163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756042d-2524-414a-a233-b2aad7444132 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:53.798437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756042d-2524-414a-a233-b2aad7444132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:53.822155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9756042d-2524-414a-a233-b2aad7444132 None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:53.823622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9756042d-2524-414a-a233-b2aad7444132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:53.838351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:53.904476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 849/1720] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:53.906191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756042d-2524-414a-a233-b2aad7444132 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:53.972591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 872/1721] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:53.972591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.041506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756042d-2524-414a-a233-b2aad7444132 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.107445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584586b-b2e6-4ac5-a7b8-a2fcadcf5b25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.115772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.116672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.117621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.118472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.127285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.128419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.129781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.129781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.130934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.134213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.135199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.138483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.157334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 873/1722] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:54.159236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.199429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef03b-270c-4032-839a-cb2d15b91b03 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.217110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.220537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.220537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.220537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.220537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.227030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.298451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 850/1723] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:53 2022] POST /identity/v3/users => generated 296 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:54.299266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.302432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:54.357664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 874/1724] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:54 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:54.361347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.412320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4125b-ac0e-4011-81fb-8bc1c5cabc17 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.432156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.435338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.437121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.437256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.438572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.446325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.508440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 875/1725] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:54.513284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.517471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:54.539427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0c82-5282-4988-94a4-c56eaf3538db admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.554678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.556711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.556711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.556711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.556711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.558236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.591223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 876/1726] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:54.592229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.595884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:54.605718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93348-e002-4648-984f-ec604f7b3194 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.624911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.627034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.627519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.627932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.764788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.766714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.774983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e1c2-c6f7-4925-ba7d-8eda148f7220 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.786572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.788186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.788691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 851/1727] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:54.789685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.805593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.813431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6c967-d478-4ecf-9297-372804e7abde service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.814357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.822000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:54.824436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:54.827796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:54.828103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:54.828401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] PATH_INFO: `/v3/projects/2a37763e3027443ca09bb79b4beffdb1/users/a32c3a936e0f40daac49d9efd13691ba/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:54.868803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.883521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.921128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 877/1728] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:54.923622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:54.953572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a37763e3027443ca09bb79b4beffdb1, user_id=a32c3a936e0f40daac49d9efd13691ba, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:54.970094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f97b-a749-423a-99b2-ae36900f6799 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:54.977814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:54.996454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:55.000143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.001151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.003042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.005190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:55.015733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:55.062374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 878/1729] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:55.066684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:55.083653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 852/1730] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:54 2022] PUT /identity/v3/projects/2a37763e3027443ca09bb79b4beffdb1/users/a32c3a936e0f40daac49d9efd13691ba/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:55.088157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:55.102206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f03d-3fac-49c8-a0a7-ee5e39d708ea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:55.245809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21e28-0fcf-4a8e-9520-53980af07400 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:55.259917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:55.262113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.266497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.266497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.279182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:55.284814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:55.308959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:55.310833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.313507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.314054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] PATH_INFO: `/v3/projects/0396ed8b259c47b38c47405732e12c72/users/1e04004b305b45b190972fb1924021c5/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.345353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 853/1731] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:55.346498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:55.384509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0396ed8b259c47b38c47405732e12c72, user_id=1e04004b305b45b190972fb1924021c5, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:55.390356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cda512-cbc3-4a39-b45f-7fe297f3bc54 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:55.392525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7d42a-1ece-45a5-a826-3d2f83cdb53a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:55.414580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:55.424072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.424072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.427789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] PATH_INFO: `/v3/projects/2a37763e3027443ca09bb79b4beffdb1/users/a32c3a936e0f40daac49d9efd13691ba/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.434314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a37763e3027443ca09bb79b4beffdb1, user_id=a32c3a936e0f40daac49d9efd13691ba, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:55.443735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d5f2-6f98-4e1a-9132-18703e846568 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:55.515819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 854/1732] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:55 2022] PUT /identity/v3/projects/2a37763e3027443ca09bb79b4beffdb1/users/a32c3a936e0f40daac49d9efd13691ba/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:55.517781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061de5-a275-4247-af23-ae081484af7f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.518135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061de5-a275-4247-af23-ae081484af7f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.518417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061de5-a275-4247-af23-ae081484af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.554012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 879/1733] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:55 2022] PUT /identity/v3/projects/0396ed8b259c47b38c47405732e12c72/users/1e04004b305b45b190972fb1924021c5/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:55.569827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194480-c56f-4029-980f-ff34c1f6be59 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.570498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194480-c56f-4029-980f-ff34c1f6be59 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.570498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194480-c56f-4029-980f-ff34c1f6be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.598374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1b061de5-a275-4247-af23-ae081484af7f None None] MFA Rules not processed for user `a32c3a936e0f40daac49d9efd13691ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:55.603161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1b061de5-a275-4247-af23-ae081484af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:55.676645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-73194480-c56f-4029-980f-ff34c1f6be59 None None] MFA Rules not processed for user `1e04004b305b45b190972fb1924021c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:55.676645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-73194480-c56f-4029-980f-ff34c1f6be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:55.815233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 855/1734] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:55.840007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b061de5-a275-4247-af23-ae081484af7f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:55.845642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1b061de5-a275-4247-af23-ae081484af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:55.958436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 880/1735] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:36:55.962611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.962902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.963184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:55.983391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b061de5-a275-4247-af23-ae081484af7f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:55.985008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:55.987551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:55.987878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:55.988296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.004564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.009174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:56.039644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 856/1736] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:56.055152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:56.068379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] MFA Rules not processed for user `e2d6c76ba6c34f219faf59f9dd1b1fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:56.079073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:56.287991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ec3f9-4682-43a3-b427-6e02be622fa5 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:56.317804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 881/1737] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:56.319371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:56.320117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:56.320477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:56.348682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.352231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.362430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:56.389411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:56.391084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:56.430586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde18b-3e3b-4561-ae41-3ce8c41e512f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:56.449583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:56.449583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:56.449583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:56.449583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] PATH_INFO: `/v3/users/5d92aa2cca92456a9b2a5101c89de975` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.450043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d92aa2cca92456a9b2a5101c89de975)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.451800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:56.537768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 857/1738] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:56 2022] POST /identity/v3/projects => generated 373 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:56.545001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:56.699562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6b5c-055c-48ed-af45-33e8b60419cb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:56.699562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:56.699729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:56.700186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:56.700355 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.700982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.703030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:56.721268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:56.811935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 858/1739] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:36:56 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:56.816986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:56.842958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d92aa2cca92456a9b2a5101c89de975'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:56.864482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32833-91a8-49bb-81de-b2026854ded5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:56.883515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:56.885659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d92aa2cca92456a9b2a5101c89de975'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:56.887638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d92aa2cca92456a9b2a5101c89de975'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:56.889207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:56.889685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:56.891348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.892239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.897204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:56.904127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:56.915914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d92aa2cca92456a9b2a5101c89de975'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:56.917541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb981192-1e62-406a-b2d6-bfbb1ef5f641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d92aa2cca92456a9b2a5101c89de975'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:56.927900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 859/1740] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:56.933162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:56.936681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:56.961410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fda0-edfd-46df-99aa-f836b1188236 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:56.968594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:56.969293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:56.969582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:56.969878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] PATH_INFO: `/v3/projects/6fa327b5af5145f5b47e26bb9a13554b/users/a70618c8d2ef4154b657033f2f439836/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:56.990949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa327b5af5145f5b47e26bb9a13554b, user_id=a70618c8d2ef4154b657033f2f439836, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:56.993859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1017d5-274e-46b9-8472-12ff39eb38e5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:57.065092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 882/1741] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:56 2022] DELETE /identity/v3/users/5d92aa2cca92456a9b2a5101c89de975 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:57.080629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.084171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.085492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.146789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] MFA Rules not processed for user `c6ed88668fa04f3f8b423af40e240557`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:57.149914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:57.177206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 860/1742] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:56 2022] PUT /identity/v3/projects/6fa327b5af5145f5b47e26bb9a13554b/users/a70618c8d2ef4154b657033f2f439836/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:57.178635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.178850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.179080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.226860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:57.228309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:57.247994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 883/1743] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:57.250500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:57.494110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 861/1744] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:57.504602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:57.508971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:57.527251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f682-4854-490a-9d34-c1cfa2966bc8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:57.560825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:57.560825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.560825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.560825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.561165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:57.563430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:57.603640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 884/1745] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:36:57.605091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:57.631217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cb9c-d82e-4abb-a951-7a07a2ee109f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:57.642566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:57.643609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.647392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.647806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] PATH_INFO: `/v3/projects/6fa327b5af5145f5b47e26bb9a13554b/users/a70618c8d2ef4154b657033f2f439836/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.653707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa327b5af5145f5b47e26bb9a13554b, user_id=a70618c8d2ef4154b657033f2f439836, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:57.658997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c203a-80ec-4369-b4e0-44018ed7cfef admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:57.681636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e2598-0a3f-4b53-8c00-945f8fbf2744 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:57.689802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 885/1746] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:36:57 2022] PUT /identity/v3/projects/6fa327b5af5145f5b47e26bb9a13554b/users/a70618c8d2ef4154b657033f2f439836/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:57.701033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.701418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.701809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.793301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] MFA Rules not processed for user `a70618c8d2ef4154b657033f2f439836`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:36:57.799473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:57.822089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:57.828211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:57.828211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:57.828211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:57.962896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:57.968880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:57.982248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 862/1747] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:36:57.984222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:57.990238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:58.038487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 886/1748] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:36:58.051413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:58.052889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:58.174672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317f54-02af-4c51-8372-cab80b3ac50a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:58.199399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32c3a936e0f40daac49d9efd13691ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a37763e3027443ca09bb79b4beffdb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:58.199399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:58.199399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:58.208215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:58.208215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:58.208215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:58.208215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:58.217378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7e43-88fb-4eb5-a3fc-bc3330ceceff None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:58.236816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 863/1749] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:36:58.239202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:58.239310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:58.247566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:58.247929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:58.253887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:58.263866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199da54-9ef5-4183-a1b8-eeaca29efa24 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:58.273780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32c3a936e0f40daac49d9efd13691ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a37763e3027443ca09bb79b4beffdb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:58.274421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:58.275043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:58.275340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:58.276021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:58.279649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:58.295720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:58.303992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:58.350842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 887/1750] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:36:58.440897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:58.442876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 864/1751] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:36:58 2022] POST /identity/v3/projects => generated 354 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:36:58.481525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41bcc-51be-4139-aef0-a5c7df13f215 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:58.684812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32c3a936e0f40daac49d9efd13691ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a37763e3027443ca09bb79b4beffdb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:58.685900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:58.686404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:58.687184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:58.689145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:36:58.690043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:58.697093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:58.710981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 888/1752] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:36:58.839537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:58.851557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdf6ae-0a17-4d17-abdf-d664d64c885e tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:58.868878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32c3a936e0f40daac49d9efd13691ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a37763e3027443ca09bb79b4beffdb1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:58.869587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:58.869906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:58.870192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] PATH_INFO: `/v3/projects/dcdbb102c748448a8091c8b1dfc98081` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:58.873889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dcdbb102c748448a8091c8b1dfc98081)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:58.881212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:58.986384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:58.988524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:59.097557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcdbb102c748448a8091c8b1dfc98081', 'request_id': 'req-f83d190a-a100-4218-8522-434c2793c8b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.121486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcdbb102c748448a8091c8b1dfc98081', 'request_id': 'req-f83d190a-a100-4218-8522-434c2793c8b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.141022 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:59.191915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33067ac-4b6f-4ea7-9d41-9084403979a1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:36:59.235986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcdbb102c748448a8091c8b1dfc98081', 'request_id': 'req-f83d190a-a100-4218-8522-434c2793c8b1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.293282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] The token cache is being invalidate because project dcdbb102c748448a8091c8b1dfc98081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:59.296206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.297868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.308032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 865/1753] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:58 2022] DELETE /identity/v3/projects/dcdbb102c748448a8091c8b1dfc98081 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:36:59.388749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:36:59.389290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:36:59.389599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:36:59.389829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] PATH_INFO: `/v3/projects/b8052c93240b42c7a06882eeddcd7b23` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:36:59.393986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8052c93240b42c7a06882eeddcd7b23)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:36:59.413411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:36:59.632955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8052c93240b42c7a06882eeddcd7b23', 'request_id': 'req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.640215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8052c93240b42c7a06882eeddcd7b23', 'request_id': 'req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.805192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8052c93240b42c7a06882eeddcd7b23', 'request_id': 'req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.824756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] The token cache is being invalidate because project b8052c93240b42c7a06882eeddcd7b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:36:59.826554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.827656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:36:59.835413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 889/1754] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:36:58 2022] DELETE /identity/v3/projects/b8052c93240b42c7a06882eeddcd7b23 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:36:59.839755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:36:59.844142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:36:59.873933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190a-a100-4218-8522-434c2793c8b1 tempest-VolumeQuotaClassesTest-810692402 tempest-VolumeQuotaClassesTest-810692402-project-admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:00.000761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:00.000761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:00.000761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:00.000761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] PATH_INFO: `/v3/users/9547a10843014c65897b4d54d04c307d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:00.002282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9547a10843014c65897b4d54d04c307d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:00.004087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:00.238947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:00.272668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:00.277769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:00.287381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9547a10843014c65897b4d54d04c307d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.288427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9547a10843014c65897b4d54d04c307d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.308989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8eb89-4f30-4d44-a251-2d1f75ac26af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:00.312469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9547a10843014c65897b4d54d04c307d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.324350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:00.327968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:00.328347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9547a10843014c65897b4d54d04c307d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.328680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:00.329286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] PATH_INFO: `/v3/users/1e04004b305b45b190972fb1924021c5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:00.330884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e04004b305b45b190972fb1924021c5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:00.333344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:00.427945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9547a10843014c65897b4d54d04c307d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.435182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 866/1755] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:36:59 2022] DELETE /identity/v3/users/9547a10843014c65897b4d54d04c307d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:00.445718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:00.455894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:00.569802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc7bcf-87ac-4c67-8106-31be931a1617 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:00.576332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:00.579000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:00.579000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:00.579000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] PATH_INFO: `/v3/users/3e8750b060bf449d8984121398748caf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:00.579316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8750b060bf449d8984121398748caf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:00.581381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:00.656193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e04004b305b45b190972fb1924021c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.665378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e04004b305b45b190972fb1924021c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.666553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e04004b305b45b190972fb1924021c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.697637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e04004b305b45b190972fb1924021c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.698716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-074ad875-fc67-4a72-9f3d-d8fd833e8ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e04004b305b45b190972fb1924021c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.830157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 890/1756] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:00 2022] DELETE /identity/v3/users/1e04004b305b45b190972fb1924021c5 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:00.834501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:00.834795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:00.835078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:00.859025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:00.860627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:00.861912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8750b060bf449d8984121398748caf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.862596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8750b060bf449d8984121398748caf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.871220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8750b060bf449d8984121398748caf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.888917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8750b060bf449d8984121398748caf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.976916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 891/1757] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:00.984597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:00.992803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8914a3f-134c-466f-b43a-40bf4bd79492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8750b060bf449d8984121398748caf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:00.998458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:01.011415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 867/1758] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:00 2022] DELETE /identity/v3/users/3e8750b060bf449d8984121398748caf => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:01.016138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:01.018447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:01.023476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:01.093639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:01.094908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:01.222876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecca214-fec8-4672-8546-44bb0024808c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:01.242621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 868/1759] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:01.246521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:01.248540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:01.278970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb7080-7415-4ba4-956a-c94445d17a9d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:01.301489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:01.302202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:01.302484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:01.303455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] PATH_INFO: `/v3/projects/f8377d55016f4067bf2333df17e16573` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:01.304610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8377d55016f4067bf2333df17e16573)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:01.306621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:01.446745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:01.447315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:01.447315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:01.447633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:01.456794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:01.506217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:01.512169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:01.533386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 892/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:01.548279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8377d55016f4067bf2333df17e16573', 'request_id': 'req-62b0c269-c47b-4b0d-b4b5-0721be165ed9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:01.561487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:01.569887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:01.570427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:01.609126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8377d55016f4067bf2333df17e16573', 'request_id': 'req-62b0c269-c47b-4b0d-b4b5-0721be165ed9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:01.615349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2b783-4d70-4496-8ed7-83514634ca0f service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:01.789932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:01.793099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:01.794324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:01.803913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8377d55016f4067bf2333df17e16573', 'request_id': 'req-62b0c269-c47b-4b0d-b4b5-0721be165ed9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:01.845651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:01.880550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] The token cache is being invalidate because project f8377d55016f4067bf2333df17e16573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:01.880550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:01.880550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62b0c269-c47b-4b0d-b4b5-0721be165ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:01.880550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 869/1761] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:01 2022] DELETE /identity/v3/projects/f8377d55016f4067bf2333df17e16573 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:01.880550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ae43-c42b-4b10-9646-b0deb77bdb45 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:01.881189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ae43-c42b-4b10-9646-b0deb77bdb45 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:01.881189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ae43-c42b-4b10-9646-b0deb77bdb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:01.928122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2747ae43-c42b-4b10-9646-b0deb77bdb45 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:01.932953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2747ae43-c42b-4b10-9646-b0deb77bdb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:02.103772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.103772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.104492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 870/1762] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:02.107061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.107356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.108035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.116835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 893/1763] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:02.155478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:02.157330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:02.171758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 871/1764] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:02.173013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.174545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:02.201242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1edebf-dde6-4dfa-ba91-3fca78e4df8a service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.216559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.217320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.217614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.217960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.219173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:02.219421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.227101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f7fc0-8727-4468-a221-3bebe6855205 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.259752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.265865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 894/1765] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:02.275206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552b47-2e24-46c5-9eb0-edf15fcf31ef None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.289360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.290000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.308163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.308163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.308163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.308163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.464623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.465146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.465342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.492117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 872/1766] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:02 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:02.493656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.570693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:02.571993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:02.623884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccba6d-3957-44c4-b6c9-d631632c8f4d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.639766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.640409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.640922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.641798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.642565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.645667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.708196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 895/1767] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:02.809329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 873/1768] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:02 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:02.810921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.858092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6296b-513c-4b7a-992b-cd3d32d306d9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.883028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.883708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.883985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.889680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.890455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.894983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.918706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 896/1769] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:02.919234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.931741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec755b4-ec1c-4d9a-80e9-9a33a1c3deae admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.943164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.944061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.944736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.944736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:02.945324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:02.947295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:02.965619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 874/1770] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:02.967790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:02.982126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6273c5e-7a80-46a8-838c-29bc0566544b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:02.987782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:02.988351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:02.988584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:02.988982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] PATH_INFO: `/v3/projects/52114d294631435ca21dcd91ccae2962/users/531d6f638b5846dbbec810993aff82da/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:03.009949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52114d294631435ca21dcd91ccae2962, user_id=531d6f638b5846dbbec810993aff82da, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:03.013001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ec89-d12d-4701-9a01-d16779cbcb41 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:03.083592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:03.122628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:03.124615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:03.167269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 897/1771] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:02 2022] PUT /identity/v3/projects/52114d294631435ca21dcd91ccae2962/users/531d6f638b5846dbbec810993aff82da/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:03.178671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:03.179330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:03.180261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:03.257654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] MFA Rules not processed for user `531d6f638b5846dbbec810993aff82da`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:03.261064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:03.337665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26baa14-dc54-4b07-bb20-2de1c3dbb3c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:03.363998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 898/1772] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:03.368267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:03.491829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:03.492863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:03.493343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:03.493911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:03.510258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fb774-8228-4855-b123-1876b85795b8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:03.522057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:03.523064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:03.527917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:03.528504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:03.529371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:03.532080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:03.587195 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:03.590117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:03.599622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 875/1773] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:37:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 16:37:03.755520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:03.756987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:03.758118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 899/1774] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:03 2022] POST /identity/v3/projects => generated 383 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:03.762850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:03.788577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83d4e8-c2ef-477b-8d00-3aeebac3e995 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:03.913382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74748-89c3-4380-818b-093bc8c4686d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:03.920384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:03.921300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:03.921408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:03.921895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:03.922797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:03.931251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:03.995586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:03.996621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:03.997281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:03.997867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] PATH_INFO: `/v3/projects/0396ed8b259c47b38c47405732e12c72` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.000197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0396ed8b259c47b38c47405732e12c72)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.004887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:04.075994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 900/1775] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:03 2022] POST /identity/v3/users => generated 298 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:04.087557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:04.102166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8dc81-469c-4fb1-8633-7db174665c18 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:04.112474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:04.113115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:04.113481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:04.113706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.114342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.116007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:04.145993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 901/1776] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:04.152398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:04.173599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf4f99-b74d-422c-a34d-3a5980256ee9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:04.180834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:04.181847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:04.182284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:04.182722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] PATH_INFO: `/v3/projects/52fae3ad73994919b40138eec05a25ca/users/f583c5cfd56342eeac3fe5b95697ebad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.223268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fae3ad73994919b40138eec05a25ca, user_id=f583c5cfd56342eeac3fe5b95697ebad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.229138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:04.235596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0396ed8b259c47b38c47405732e12c72', 'request_id': 'req-777536c5-8fd7-4c31-b817-0c6fb6563b75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:04.246957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0396ed8b259c47b38c47405732e12c72', 'request_id': 'req-777536c5-8fd7-4c31-b817-0c6fb6563b75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:04.358980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 902/1777] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:04 2022] PUT /identity/v3/projects/52fae3ad73994919b40138eec05a25ca/users/f583c5cfd56342eeac3fe5b95697ebad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:04.367220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:04.378429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0396ed8b259c47b38c47405732e12c72', 'request_id': 'req-777536c5-8fd7-4c31-b817-0c6fb6563b75'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:04.381272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:04.408192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] The token cache is being invalidate because project 0396ed8b259c47b38c47405732e12c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:04.408192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:04.409912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:04.412615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 876/1778] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:03 2022] DELETE /identity/v3/projects/0396ed8b259c47b38c47405732e12c72 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:04.417713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:04.422252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:04.598607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777536c5-8fd7-4c31-b817-0c6fb6563b75 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:04.759457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975915d0-a029-4395-9bb4-1028c59826a6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:04.759457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:04.759457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:04.759457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:04.762700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.762700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.762700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:04.762700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 903/1779] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:04.762700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:04.764608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:04.764608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:04.764608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:04.765553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] PATH_INFO: `/v3/users/a70618c8d2ef4154b657033f2f439836` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.774220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70618c8d2ef4154b657033f2f439836)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.780999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:04.782717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:04.832805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a44d-9d88-4b8b-b3da-10fb1e0536ff admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:04.852158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:04.852854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:04.854026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:04.855519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] PATH_INFO: `/v3/projects/46970ba7d45740589534b8a9fa9acab6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:04.861348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46970ba7d45740589534b8a9fa9acab6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:04.865218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:05.304691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70618c8d2ef4154b657033f2f439836'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.306236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70618c8d2ef4154b657033f2f439836'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.314334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46970ba7d45740589534b8a9fa9acab6', 'request_id': 'req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.332278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70618c8d2ef4154b657033f2f439836'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.334501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46970ba7d45740589534b8a9fa9acab6', 'request_id': 'req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.364462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70618c8d2ef4154b657033f2f439836'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.475998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46970ba7d45740589534b8a9fa9acab6', 'request_id': 'req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.499652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] The token cache is being invalidate because project 46970ba7d45740589534b8a9fa9acab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:05.510876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.510876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.510876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 904/1780] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:04 2022] DELETE /identity/v3/projects/46970ba7d45740589534b8a9fa9acab6 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:05.510876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:05.510876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:05.655732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159ba4-9a1d-4dda-93e1-9a30cf1d4c7e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:05.662286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:05.663517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:05.664012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:05.664461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] PATH_INFO: `/v3/projects/52fae3ad73994919b40138eec05a25ca/users/f583c5cfd56342eeac3fe5b95697ebad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:05.669149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fae3ad73994919b40138eec05a25ca, user_id=f583c5cfd56342eeac3fe5b95697ebad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:05.674555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a755a5d-be72-41d1-9dc9-6a5ecca5b631 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:05.697508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 905/1781] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:05 2022] PUT /identity/v3/projects/52fae3ad73994919b40138eec05a25ca/users/f583c5cfd56342eeac3fe5b95697ebad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:05.709980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681615a-8008-4201-9880-194ee79addf2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:05.710656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681615a-8008-4201-9880-194ee79addf2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:05.711099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681615a-8008-4201-9880-194ee79addf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:05.737017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0681615a-8008-4201-9880-194ee79addf2 None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:05.739086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0681615a-8008-4201-9880-194ee79addf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:05.744394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70618c8d2ef4154b657033f2f439836'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:05.758007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 877/1782] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:04 2022] DELETE /identity/v3/users/a70618c8d2ef4154b657033f2f439836 => generated 0 bytes in 1338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:05.760232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:05.763714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:05.953275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 906/1783] 10.222.0.76 () {58 vars in 1015 bytes} [Fri Aug 19 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:05.964644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6561bf-d825-4382-9ad2-9598f2a6ce04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:05.966946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:05.967117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:05.967518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:05.982203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:05.983037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:05.983423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:05.983819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] PATH_INFO: `/v3/users/a32c3a936e0f40daac49d9efd13691ba` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:05.990611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32c3a936e0f40daac49d9efd13691ba)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:05.993138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:06.082181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] MFA Rules not processed for user `f583c5cfd56342eeac3fe5b95697ebad`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:06.084773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:06.258898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 907/1784] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:06.258898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:06.258898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:06.371757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:06.391321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7df23-75ac-4bab-aa7c-94986280b295 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:06.404200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:06.404836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:06.405121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:06.405394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:06.421317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:06.425547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:06.477609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 908/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:06.481985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:06.522360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32c3a936e0f40daac49d9efd13691ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:06.531412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd2c0b-de07-40b4-a2e4-39f92e53604a service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:06.531593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32c3a936e0f40daac49d9efd13691ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:06.552793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32c3a936e0f40daac49d9efd13691ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:06.553430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:06.558555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:06.559724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:06.560013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:06.591632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32c3a936e0f40daac49d9efd13691ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:06.604575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:06.604575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:06.636097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 909/1786] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:06.637280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:06.642316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:06.748599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b71-0fbf-4bbf-afe3-dc8e8ef0c307 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:06.754168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:06.754821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:06.755111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:06.755429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:06.775258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:06.778879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32c3a936e0f40daac49d9efd13691ba'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:06.790125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 878/1787] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:05 2022] DELETE /identity/v3/users/a32c3a936e0f40daac49d9efd13691ba => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:06.791062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:06.807202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 910/1788] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:07.074658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:07.077089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:07.354164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1729-2850-4b02-9852-d2500aafe1ce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:07.361284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:07.362003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:07.362291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:07.362565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:07.366366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:07.483907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:07.485800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:07.502559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 879/1789] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:07.702640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:07.705207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:07.840647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d966f1-92ff-4b21-8f01-810fedc9ea7f service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:07.937718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:07.940862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:07.942075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:07.943070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] PATH_INFO: `/v3/projects/6fa327b5af5145f5b47e26bb9a13554b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:07.946176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa327b5af5145f5b47e26bb9a13554b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:07.949303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:08.186491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa327b5af5145f5b47e26bb9a13554b', 'request_id': 'req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.202959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa327b5af5145f5b47e26bb9a13554b', 'request_id': 'req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.328633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:08.332407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:08.476636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1b19-8f02-4144-a91c-98857e469f69 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:08.573459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa327b5af5145f5b47e26bb9a13554b', 'request_id': 'req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.596138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] The token cache is being invalidate because project 6fa327b5af5145f5b47e26bb9a13554b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:08.596487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.597233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4d4ad168-85cd-4e55-9cb5-00d3f21b80e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.599071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 911/1790] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:07 2022] DELETE /identity/v3/projects/6fa327b5af5145f5b47e26bb9a13554b => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:08.601425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:08.602787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:08.605075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:08.606904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:08.621669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:08.621669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:08.622635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:08.622635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] PATH_INFO: `/v3/projects/2a37763e3027443ca09bb79b4beffdb1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:08.622635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a37763e3027443ca09bb79b4beffdb1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:08.652110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:08.653686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:08.660590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:08.670608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 912/1791] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:08.675693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:08.675693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:08.690343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4a8b1-c2c1-4189-a2be-bd105b176830 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:08.696434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:08.698303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:08.698769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:08.699190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] PATH_INFO: `/v3/users/531d6f638b5846dbbec810993aff82da` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:08.700875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] RBAC: Authorizing `identity:delete_user(user_id=531d6f638b5846dbbec810993aff82da)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:08.703383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:08.971300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531d6f638b5846dbbec810993aff82da'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.983967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a37763e3027443ca09bb79b4beffdb1', 'request_id': 'req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.995534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a37763e3027443ca09bb79b4beffdb1', 'request_id': 'req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:08.999009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531d6f638b5846dbbec810993aff82da'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.001857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531d6f638b5846dbbec810993aff82da'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.065251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531d6f638b5846dbbec810993aff82da'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.066368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bc4b8442-c39b-4c44-a5ff-f6b115f6535a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531d6f638b5846dbbec810993aff82da'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.295283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a37763e3027443ca09bb79b4beffdb1', 'request_id': 'req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.318399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] The token cache is being invalidate because project 2a37763e3027443ca09bb79b4beffdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:09.318839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.319663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1384bc0c-f900-4f3a-95ec-1970e2d90f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:09.324590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 880/1792] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:08 2022] DELETE /identity/v3/projects/2a37763e3027443ca09bb79b4beffdb1 => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:09.328131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f632-6790-4a96-ad41-3084980a6c47 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.328630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f632-6790-4a96-ad41-3084980a6c47 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.329292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f632-6790-4a96-ad41-3084980a6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.387079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-58f1f632-6790-4a96-ad41-3084980a6c47 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:09.389500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-58f1f632-6790-4a96-ad41-3084980a6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.453134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 913/1793] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:08 2022] DELETE /identity/v3/users/531d6f638b5846dbbec810993aff82da => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:09.458996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a076-494f-4278-967b-3b1b839dc28e None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.458996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a076-494f-4278-967b-3b1b839dc28e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.465443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a076-494f-4278-967b-3b1b839dc28e None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.470694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 914/1794] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:37:09 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:37:09.472365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10169e-6928-40df-b8a8-d7f6933b9a12 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.475650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10169e-6928-40df-b8a8-d7f6933b9a12 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.476061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10169e-6928-40df-b8a8-d7f6933b9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.561637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b10169e-6928-40df-b8a8-d7f6933b9a12 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:09.561637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b10169e-6928-40df-b8a8-d7f6933b9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.591850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 881/1795] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:09.596299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.610876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.611452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.642552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:09.646117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.703564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 915/1796] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:09.709243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282512-1095-4718-ad12-266eed700d6c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.709243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282512-1095-4718-ad12-266eed700d6c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.709243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282512-1095-4718-ad12-266eed700d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.726555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 882/1797] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:09.728072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:09.746155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-42282512-1095-4718-ad12-266eed700d6c None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:09.748101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13a76f-7901-4c23-bbef-9f7ef32cb16a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:09.748383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42282512-1095-4718-ad12-266eed700d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.761729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:09.762364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.762639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.762908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.768037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:09.768329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:09.769986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8efc2-d632-4fff-8b50-cb4990076c89 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:09.812399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 883/1798] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:09.813785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.814075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.814352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.839746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 916/1799] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:09.841089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282512-1095-4718-ad12-266eed700d6c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:09.842754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42282512-1095-4718-ad12-266eed700d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.885708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:09.886921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:09.921317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 884/1800] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:09.924137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:09.955876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35f74-ea28-457e-ad23-1faf7ba9e0cd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:09.969469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282512-1095-4718-ad12-266eed700d6c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:09.972423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:09.973046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.973332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.973610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:09.974254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:09.982721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:09.987113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:09.988151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:09.988675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:09.989168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.011274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.012782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90702-7424-4ae9-9a6d-a5b508266d07 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.031252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 917/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:10.032605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b750-d64a-4810-8992-2af46f92c794 None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.032889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b750-d64a-4810-8992-2af46f92c794 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.034912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b750-d64a-4810-8992-2af46f92c794 None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.049332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 918/1802] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:37:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:37:10.053060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b750-d64a-4810-8992-2af46f92c794 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.092238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 885/1803] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:09 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:10.096088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.123184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b750-d64a-4810-8992-2af46f92c794 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.241437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33863c-fdf0-463f-96bd-a99874ba39f3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.263341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.264617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.265090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.266290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.267277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.270479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.277785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.278824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.278824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.278987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.279639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:10.279954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.281596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.320852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 919/1804] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:10.321557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.332741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:10.505333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5038e9-3b87-43b3-a184-d25ff4871b62 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.512659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.513521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.513821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.514104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.531546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.531546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bcd5e-4282-47f0-ad8e-f95fac2422e0 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.540650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 920/1805] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:10.544086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.544482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.544740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.575188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:10.576663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:10.588648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 921/1806] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:10.589500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.593582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 886/1807] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:10 2022] POST /identity/v3/users => generated 284 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:10.598348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.603883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14af77-70f7-4206-8079-52bdc95057fb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.623178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.624009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca551ae-4d68-46ae-b35e-2594375f1d18 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.624317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.625399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.626165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.627019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.630751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.636792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.637804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.637940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.638378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.639452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.654289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.671270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 887/1808] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:10.677880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.697418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5ec8-dc95-4f40-8944-061bd0a50d80 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.706453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.707507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.708258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.709017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.710040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.712223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.729293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 888/1809] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:10.743667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.750678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 922/1810] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:10 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:10.751791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:10.780986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cd6cd-9a5a-49a8-b260-e797d9403bea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.857323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fea88-234b-4574-be88-a96fde970467 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:10.864145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.867713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.867713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.867713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.867713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.868690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.933861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:10.934988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:10.935406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:10.943170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] PATH_INFO: `/v3/projects/252ed82b000f4ba584ea9fe8dd2dde75/users/75de82a8e2f845b2b9e93595a8f825b3/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:10.955477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=252ed82b000f4ba584ea9fe8dd2dde75, user_id=75de82a8e2f845b2b9e93595a8f825b3, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:10.960098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6d278-5bc0-45b5-ab30-3926a87ab39a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:10.973528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 923/1811] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:10 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:10.979503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.000569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f1fc8-462d-4b8c-9798-3484c4df1c49 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.004508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.005168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.005580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.006124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.006921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.009045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.034678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 924/1812] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:11.052793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.100793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 889/1813] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:10 2022] PUT /identity/v3/projects/252ed82b000f4ba584ea9fe8dd2dde75/users/75de82a8e2f845b2b9e93595a8f825b3/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:11.102535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.102923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.103367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.103455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65546-fd42-454d-a550-5e7c5e90aecb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.152948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] MFA Rules not processed for user `75de82a8e2f845b2b9e93595a8f825b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:11.154241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:11.251705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 890/1814] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:11.255252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.298791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.301556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.302246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.302732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.303876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.306256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.332608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 925/1815] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:11.334567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.338381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b762c1-9020-4a68-b47f-e63968f5b16f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.347615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.347615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.347615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.347615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.347971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.348977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.350142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89056fd3-e6ec-4810-9924-3774045d7e2a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.368136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.369128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.370220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.370719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] PATH_INFO: `/v3/projects/05b33c6c8e6e42beaa23eead0fdd78b2/users/4cc74c8e1c2d42c191f00131276fb7d5/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.413684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b33c6c8e6e42beaa23eead0fdd78b2, user_id=4cc74c8e1c2d42c191f00131276fb7d5, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.421051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fc8c8-fba8-4652-84bc-45419da9f9c3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.652000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 926/1816] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:11 2022] PUT /identity/v3/projects/05b33c6c8e6e42beaa23eead0fdd78b2/users/4cc74c8e1c2d42c191f00131276fb7d5/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:11.665378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 891/1817] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:11 2022] POST /identity/v3/projects => generated 367 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:11.668332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.668332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.668332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.671327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.714478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] MFA Rules not processed for user `4cc74c8e1c2d42c191f00131276fb7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:11.721653 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:11.783859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b04f4-9622-46b0-9d5b-203766d71c37 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.793769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.795408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.800144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.800144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.800144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.801399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.802874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:11.814160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 927/1818] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:11.815164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.828241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8a3e8-8678-4221-ad20-0308a2f98797 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:11.869235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:11.870027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:11.870468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:11.870992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:11.871770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:11.874386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:11.964450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 892/1819] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:11 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:11.965799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:11.967784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:11.987521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 928/1820] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:11 2022] POST /identity/v3/projects => generated 393 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:11.990819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.077334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:12.277984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11a79-3282-48e9-b71d-d8087a2c0a81 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.278483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf074-fef8-4b86-92e9-2e8079d02a70 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.278483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.278483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.278483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 929/1821] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.278761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdf0d4-5138-40be-aab1-2703aa433efd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.279233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.279233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.279233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.279233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.279507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.279507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.327788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.329748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.330521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.331147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.367104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.371015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.405940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 893/1822] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:12.407230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.421219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0814-b951-4e85-a3a4-ebacd6056508 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.429869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.433064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.433064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.433064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] PATH_INFO: `/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef/users/09abb6f52f054cdf990f60dee1b9acad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.461576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcc3de9d5f14e8b993f6cc7ba8461ef, user_id=09abb6f52f054cdf990f60dee1b9acad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.500480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 930/1823] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:12 2022] POST /identity/v3/users => generated 303 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:12.506797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.513590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.563645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456516-a091-493f-bd97-d7bbbf1c5538 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.584338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.585006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.585289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.585587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.586245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.587984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.619224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 931/1824] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:12.623598 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.642102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b8ca-3015-4a6c-9dd5-27f559587894 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:12.656220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:12.656946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:12.657229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:12.657505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] PATH_INFO: `/v3/projects/f5a479402fb944e19a0b543986d8b308/users/833cfb3495c94e63a683c6f6c99f2f64/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:12.681314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a479402fb944e19a0b543986d8b308, user_id=833cfb3495c94e63a683c6f6c99f2f64, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:12.684465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:12.866922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 894/1825] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:12 2022] PUT /identity/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef/users/09abb6f52f054cdf990f60dee1b9acad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:12.869234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:12.935407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 932/1826] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:12 2022] PUT /identity/v3/projects/f5a479402fb944e19a0b543986d8b308/users/833cfb3495c94e63a683c6f6c99f2f64/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:12.939877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.062042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ebd07-aaec-4c61-98d3-82586e5ec706 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:13.123224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316c87c-0f35-4ba8-b66f-8b126837b4ce admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:13.132493 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:13.133142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.133433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.136221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.137904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:13.141909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:13.191933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 933/1827] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:13.193147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.198616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:13.244439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:13.245618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.251968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.251968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.251968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:13.251968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:13.268156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a9c1d-9fbe-4c60-a1ff-4c0bf5046ee5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:13.281610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 895/1828] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:13.281610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.306096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49af47-e71d-4029-b1ba-27c91609caed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:13.318041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:13.318041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.318041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.318041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] PATH_INFO: `/v3/projects/52114d294631435ca21dcd91ccae2962` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.319766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52114d294631435ca21dcd91ccae2962)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:13.319766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:13.322223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:13.323545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.323907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.324416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] PATH_INFO: `/v3/projects/f5a479402fb944e19a0b543986d8b308/users/833cfb3495c94e63a683c6f6c99f2f64/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.332585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a479402fb944e19a0b543986d8b308, user_id=833cfb3495c94e63a683c6f6c99f2f64, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:13.335413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:13.364172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 896/1829] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:13 2022] PUT /identity/v3/projects/f5a479402fb944e19a0b543986d8b308/users/833cfb3495c94e63a683c6f6c99f2f64/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:13.365068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.471563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba28b0-d1cf-4e45-a6f0-7f91d276f589 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:13.478545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:13.479886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.480171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.480712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] PATH_INFO: `/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef/users/09abb6f52f054cdf990f60dee1b9acad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.483276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcc3de9d5f14e8b993f6cc7ba8461ef, user_id=09abb6f52f054cdf990f60dee1b9acad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:13.486348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f7b7b-932b-4634-84ce-151d793a7220 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:13.499836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 897/1830] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:13 2022] PUT /identity/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef/users/09abb6f52f054cdf990f60dee1b9acad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:13.501499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32dc88-7c36-45ff-a647-950a2ce79a36 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.501976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32dc88-7c36-45ff-a647-950a2ce79a36 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.502392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32dc88-7c36-45ff-a647-950a2ce79a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.545272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f32dc88-7c36-45ff-a647-950a2ce79a36 None None] MFA Rules not processed for user `833cfb3495c94e63a683c6f6c99f2f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:13.546746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f32dc88-7c36-45ff-a647-950a2ce79a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:13.607518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52114d294631435ca21dcd91ccae2962', 'request_id': 'req-c7becb32-ee55-4907-b32f-23df472f0360'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:13.614202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52114d294631435ca21dcd91ccae2962', 'request_id': 'req-c7becb32-ee55-4907-b32f-23df472f0360'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:13.717421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 898/1831] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:13.719240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:13.719665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:13.720486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:13.761142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] MFA Rules not processed for user `09abb6f52f054cdf990f60dee1b9acad`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:13.762815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:13.934855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 899/1832] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:13.935846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.946236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:13.948332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52114d294631435ca21dcd91ccae2962', 'request_id': 'req-c7becb32-ee55-4907-b32f-23df472f0360'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:13.972782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] The token cache is being invalidate because project 52114d294631435ca21dcd91ccae2962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:13.973706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:13.974531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:13.976429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 934/1833] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:13 2022] DELETE /identity/v3/projects/52114d294631435ca21dcd91ccae2962 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:13.977371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:13.981544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.124913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c854705-b960-49ca-9044-87f7ec660f99 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:14.124913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:14.124913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:14.124913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:14.125541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:14.127647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.176646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7becb32-ee55-4907-b32f-23df472f0360 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:14.176646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:14.176646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:14.176646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:14.177017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:14.177017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.198031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:14.200245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:14.223120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 935/1834] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:14.224549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:14.226970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.239008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:14.240876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:14.253603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 900/1835] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:14.372136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:14.374084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.380696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee421dc-8f94-4380-a729-742619964416 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:14.382067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:14.382773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:14.383067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:14.383327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] PATH_INFO: `/v3/users/f583c5cfd56342eeac3fe5b95697ebad` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:14.384720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f583c5cfd56342eeac3fe5b95697ebad)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:14.386977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:14.392680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309376-197c-433c-9366-a3b714aed24c service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:14.404431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:14.405086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:14.405375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:14.405639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:14.414997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.532228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:14.535635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:14.549682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 901/1836] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:14.551284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:14.595876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aea25-6c2d-4923-82bd-1a824cd8732e service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:14.595876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:14.595876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:14.595876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:14.596339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:14.596339 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:14.686566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:14.688155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:14.703186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 902/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:14.943591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f583c5cfd56342eeac3fe5b95697ebad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:14.961494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f583c5cfd56342eeac3fe5b95697ebad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:14.964668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f583c5cfd56342eeac3fe5b95697ebad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:14.983702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f583c5cfd56342eeac3fe5b95697ebad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:14.985296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8b3bd45c-9edd-4ba1-9d91-2a5ae34e84d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f583c5cfd56342eeac3fe5b95697ebad'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:15.124515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 936/1838] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:14 2022] DELETE /identity/v3/users/f583c5cfd56342eeac3fe5b95697ebad => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:15.691964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:15.706501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a7001-2979-4017-af3a-e62e873d335a service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:15.773218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:15.774105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:15.774386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:15.774673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] PATH_INFO: `/v3/projects/52fae3ad73994919b40138eec05a25ca` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:15.776069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fae3ad73994919b40138eec05a25ca)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:15.778202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:15.934004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fae3ad73994919b40138eec05a25ca', 'request_id': 'req-ec959f2a-ca9a-4447-ad61-e98f816a0217'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:15.951147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fae3ad73994919b40138eec05a25ca', 'request_id': 'req-ec959f2a-ca9a-4447-ad61-e98f816a0217'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:16.046256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fae3ad73994919b40138eec05a25ca', 'request_id': 'req-ec959f2a-ca9a-4447-ad61-e98f816a0217'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:16.061848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] The token cache is being invalidate because project 52fae3ad73994919b40138eec05a25ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:16.062169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:16.062831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ec959f2a-ca9a-4447-ad61-e98f816a0217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:16.064356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 903/1839] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:15 2022] DELETE /identity/v3/projects/52fae3ad73994919b40138eec05a25ca => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:16.069563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.070064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.070300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.089425 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:16.096258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:16.097505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:16.159829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 937/1840] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:16.168490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.168776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.169050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.189971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:16.191283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:16.199928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 904/1841] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:16.204195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.214162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136166cd-158c-4644-999b-e93a63e52af9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.218971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.219693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.219981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.220255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.220954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:16.221280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.222964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.240261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 938/1842] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:16.240540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:16.242001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.252997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a88a9-dce3-4ad0-8895-48fbffcc4dba None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.257960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.259189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.259672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.260128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.260899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.263201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.381809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 905/1843] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:16 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:16.386895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.397238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb45d5-d695-4b76-9bde-0aa01042965d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.455805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.456422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.456706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.456983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.457622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.459716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.570565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 939/1844] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:16 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:16.575641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.593898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0e40-4be0-4752-951e-d7450dfaaa46 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.607699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.608459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.608794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.609068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.609738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.611541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.634456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 906/1845] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:16.639609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.652376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea429-c65c-44ea-a75f-f65bcce99cd9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.658559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.659396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.659972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.660551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.661528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.663745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120859d6-9ed6-40c4-a13f-aa93f3fe2ce0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.685746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 940/1846] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:16.690249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.703819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca832-1979-4d51-8608-60425c438669 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:16.710735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:16.711417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.711735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.712016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] PATH_INFO: `/v3/projects/6d5d8daa0384490ca0ac7fe69545c6ed/users/19637a8c059c44148ad50baf3c3feb6a/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.729133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5d8daa0384490ca0ac7fe69545c6ed, user_id=19637a8c059c44148ad50baf3c3feb6a, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:16.747652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:16.829606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 907/1847] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:16 2022] PUT /identity/v3/projects/6d5d8daa0384490ca0ac7fe69545c6ed/users/19637a8c059c44148ad50baf3c3feb6a/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:16.839846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:16.840138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:16.840420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:16.873012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] MFA Rules not processed for user `19637a8c059c44148ad50baf3c3feb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:16.874247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:16.940372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 941/1848] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:16.965052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:16.965052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:17.018120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156276-bf0c-4ae4-a5cf-794738a3c6b8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:17.021709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:17.022313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:17.022594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:17.022870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:17.034120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:17.034120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:17.043316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 908/1849] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:17.964547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:18.979516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:20.001190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:20.852009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:21.324357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:21.568362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:21.568362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:21.637548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ea4e-f7ef-4e97-ac59-62153eb828a5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:21.642660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:21.643500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:21.643789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:21.644081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] PATH_INFO: `/v3/users/4cc74c8e1c2d42c191f00131276fb7d5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:21.645246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc74c8e1c2d42c191f00131276fb7d5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:21.647277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:21.753466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:21.755099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:21.770840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c39ee9-9828-4802-9816-4dc19e2a4226 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:21.778983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:21.778983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:21.778983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:21.778983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] PATH_INFO: `/v3/users/75de82a8e2f845b2b9e93595a8f825b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:21.779472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75de82a8e2f845b2b9e93595a8f825b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:21.781191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:21.936841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc74c8e1c2d42c191f00131276fb7d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:21.943547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc74c8e1c2d42c191f00131276fb7d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:21.944228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc74c8e1c2d42c191f00131276fb7d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:21.955880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc74c8e1c2d42c191f00131276fb7d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:21.956524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce70ade1-dbd4-476f-a8fc-a15949c2d7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc74c8e1c2d42c191f00131276fb7d5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.117604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 942/1850] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:21 2022] DELETE /identity/v3/users/4cc74c8e1c2d42c191f00131276fb7d5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:22.122115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981b5-8503-4acc-8427-2042106cad92 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.122381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981b5-8503-4acc-8427-2042106cad92 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.122662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981b5-8503-4acc-8427-2042106cad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.141442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-820981b5-8503-4acc-8427-2042106cad92 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:22.142666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-820981b5-8503-4acc-8427-2042106cad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:22.173438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75de82a8e2f845b2b9e93595a8f825b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.174119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75de82a8e2f845b2b9e93595a8f825b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.182492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75de82a8e2f845b2b9e93595a8f825b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.196663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75de82a8e2f845b2b9e93595a8f825b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.215525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 943/1851] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:22.224901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820981b5-8503-4acc-8427-2042106cad92 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:22.226296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-820981b5-8503-4acc-8427-2042106cad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:22.285129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820981b5-8503-4acc-8427-2042106cad92 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:22.288642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:22.289122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.289399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.290320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.298411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-11d38dcd-a8c9-4bd9-b0be-b3671aad6b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75de82a8e2f845b2b9e93595a8f825b3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:22.301544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:22.302147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:22.313869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 909/1852] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:21 2022] DELETE /identity/v3/users/75de82a8e2f845b2b9e93595a8f825b3 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:22.315175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06872-0a61-421c-b6e7-54c71551eb9f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.315473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06872-0a61-421c-b6e7-54c71551eb9f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.315825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06872-0a61-421c-b6e7-54c71551eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.317011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 944/1853] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:22.340406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4df06872-0a61-421c-b6e7-54c71551eb9f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:22.341731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4df06872-0a61-421c-b6e7-54c71551eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:22.451629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 910/1854] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:22.467728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:22.487414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa58d5-c975-4aa6-9f6f-32e052087d58 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:22.564357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:22.565000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.565288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.565586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.589722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:22.591387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c794da-cdcf-4597-a89c-ff13dd3ddb56 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:22.625257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 945/1855] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:22.780999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.781436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.781882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.784186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 911/1856] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:37:22.887523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:22.913396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff859582-3623-43e6-8311-80fedab79121 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:22.914538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff859582-3623-43e6-8311-80fedab79121 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:22.914961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff859582-3623-43e6-8311-80fedab79121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:22.943452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ff859582-3623-43e6-8311-80fedab79121 None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:22.945018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff859582-3623-43e6-8311-80fedab79121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.017605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 946/1857] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:23.032560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:23.035208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.057672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98236-be6c-4a77-84ea-a7ab42fb2e03 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:23.064064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:23.064709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:23.065064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:23.065514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:23.077872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:23.078471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:23.104148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 912/1858] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:23.107463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff859582-3623-43e6-8311-80fedab79121 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:23.109166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ff859582-3623-43e6-8311-80fedab79121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.134076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff859582-3623-43e6-8311-80fedab79121 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:23.152758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:23.153737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:23.154201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:23.154655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] PATH_INFO: `/v3/projects/05b33c6c8e6e42beaa23eead0fdd78b2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:23.156193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b33c6c8e6e42beaa23eead0fdd78b2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:23.158769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:23.332357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:23.334575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.343159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b33c6c8e6e42beaa23eead0fdd78b2', 'request_id': 'req-7619e353-da79-4474-a429-0dca0b41ab21'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.349336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b33c6c8e6e42beaa23eead0fdd78b2', 'request_id': 'req-7619e353-da79-4474-a429-0dca0b41ab21'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.361091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ead6b-4985-42d2-8269-33b56d659e3d service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:23.423762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b33c6c8e6e42beaa23eead0fdd78b2', 'request_id': 'req-7619e353-da79-4474-a429-0dca0b41ab21'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.437117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] The token cache is being invalidate because project 05b33c6c8e6e42beaa23eead0fdd78b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:23.437726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.439549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.441929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:23.442515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:23.442768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 947/1859] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:23 2022] DELETE /identity/v3/projects/05b33c6c8e6e42beaa23eead0fdd78b2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:23.442869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:23.443058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] PATH_INFO: `/v3/projects/252ed82b000f4ba584ea9fe8dd2dde75` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:23.444278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252ed82b000f4ba584ea9fe8dd2dde75)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:23.446851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:23.448324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:23.450528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.464960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619e353-da79-4474-a429-0dca0b41ab21 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:23.469718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:23.470435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:23.470795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:23.471260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] PATH_INFO: `/v3/users/833cfb3495c94e63a683c6f6c99f2f64` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:23.472561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=833cfb3495c94e63a683c6f6c99f2f64)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:23.474855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:23.637791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252ed82b000f4ba584ea9fe8dd2dde75', 'request_id': 'req-c93f1095-90d6-424e-85fd-246bd7758b61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.645376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252ed82b000f4ba584ea9fe8dd2dde75', 'request_id': 'req-c93f1095-90d6-424e-85fd-246bd7758b61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.789249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252ed82b000f4ba584ea9fe8dd2dde75', 'request_id': 'req-c93f1095-90d6-424e-85fd-246bd7758b61'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.803160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] The token cache is being invalidate because project 252ed82b000f4ba584ea9fe8dd2dde75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:23.803754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.805163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.807332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 913/1860] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:23 2022] DELETE /identity/v3/projects/252ed82b000f4ba584ea9fe8dd2dde75 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:23.811516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:23.813159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:23.854643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833cfb3495c94e63a683c6f6c99f2f64'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.865365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833cfb3495c94e63a683c6f6c99f2f64'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.866225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833cfb3495c94e63a683c6f6c99f2f64'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.880945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833cfb3495c94e63a683c6f6c99f2f64'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.882160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833cfb3495c94e63a683c6f6c99f2f64'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:23.950073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1095-90d6-424e-85fd-246bd7758b61 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:23.965765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 948/1861] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:23 2022] DELETE /identity/v3/users/833cfb3495c94e63a683c6f6c99f2f64 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:23.972383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:23.973175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:23.973560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:23.973958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] PATH_INFO: `/v3/users/09abb6f52f054cdf990f60dee1b9acad` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:23.976088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09abb6f52f054cdf990f60dee1b9acad)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:23.980190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:24.283547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09abb6f52f054cdf990f60dee1b9acad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.284241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09abb6f52f054cdf990f60dee1b9acad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.291157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09abb6f52f054cdf990f60dee1b9acad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.304578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09abb6f52f054cdf990f60dee1b9acad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.377421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8b531c79-e878-4013-8f1c-aa3692077611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09abb6f52f054cdf990f60dee1b9acad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.383958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 914/1862] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:23 2022] DELETE /identity/v3/users/09abb6f52f054cdf990f60dee1b9acad => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:24.428341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:24.430037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:24.505979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5aae-d443-4c62-901f-491fd89700bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:24.515499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:24.572382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:24.573517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:24.573967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:24.574474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] PATH_INFO: `/v3/projects/f5a479402fb944e19a0b543986d8b308` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:24.575685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a479402fb944e19a0b543986d8b308)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:24.577788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:24.698643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a479402fb944e19a0b543986d8b308', 'request_id': 'req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.720738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a479402fb944e19a0b543986d8b308', 'request_id': 'req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.813136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a479402fb944e19a0b543986d8b308', 'request_id': 'req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.825931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] The token cache is being invalidate because project f5a479402fb944e19a0b543986d8b308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:24.826581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.827660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:24.829739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 949/1863] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:24 2022] DELETE /identity/v3/projects/f5a479402fb944e19a0b543986d8b308 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:24.834508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a03c-f2f1-4daa-bd11-e52e23b4f857 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:24.834800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a03c-f2f1-4daa-bd11-e52e23b4f857 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:24.835084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a03c-f2f1-4daa-bd11-e52e23b4f857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:24.861312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-de36a03c-f2f1-4daa-bd11-e52e23b4f857 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:24.870678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-de36a03c-f2f1-4daa-bd11-e52e23b4f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:24.871154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:24.872661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:24.965233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d07d9-f36e-4bef-9c4f-4e826d98f90c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:24.973478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:24.974228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:24.974592 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:24.974976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] PATH_INFO: `/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:24.976238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 915/1864] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:24.979900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcc3de9d5f14e8b993f6cc7ba8461ef)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:24.982270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:24.985068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:24.985631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:24.986005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.023842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:25.025207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:25.035275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 916/1865] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:25.039046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.048856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23da3-1156-435e-84cc-8ed34d47ed15 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.053576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.054519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.054519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.055369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.056087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:25.056399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.058075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.070875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 917/1866] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:25.075225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.085565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6ae7-a1b3-4231-8bc6-80f7cc05395e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.093043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.093716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.093996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.094268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.094902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.096843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.178077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcc3de9d5f14e8b993f6cc7ba8461ef', 'request_id': 'req-2de56e3a-b98c-401d-90db-c607ad77c65d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:25.185662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcc3de9d5f14e8b993f6cc7ba8461ef', 'request_id': 'req-2de56e3a-b98c-401d-90db-c607ad77c65d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:25.251471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcc3de9d5f14e8b993f6cc7ba8461ef', 'request_id': 'req-2de56e3a-b98c-401d-90db-c607ad77c65d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:25.266892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 918/1867] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:25.268252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.279650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] The token cache is being invalidate because project afcc3de9d5f14e8b993f6cc7ba8461ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:25.279847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:25.281265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2de56e3a-b98c-401d-90db-c607ad77c65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:25.289546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 950/1868] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:24 2022] DELETE /identity/v3/projects/afcc3de9d5f14e8b993f6cc7ba8461ef => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:25.290973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e53dff-85d1-4ca2-a53c-030182fa87a0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.291474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e53dff-85d1-4ca2-a53c-030182fa87a0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.292202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e53dff-85d1-4ca2-a53c-030182fa87a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.318810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f8e53dff-85d1-4ca2-a53c-030182fa87a0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:25.320109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f8e53dff-85d1-4ca2-a53c-030182fa87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:25.406527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 951/1869] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:25.413024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e42f9-6654-4e86-b65a-42fa66585945 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.414162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.414455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.414733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.419924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.424551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.424551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.424551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.424551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.424551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.439431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:25.440727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:25.449772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 952/1870] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:25.455023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.464160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f734f-7838-4bc5-9772-9d27d7ad153b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.469307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.469930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.470182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:25.470290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.470474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.471115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:25.471419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.473188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.486477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 953/1871] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:25.490903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.500917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ffe2-2af2-4f24-bc17-c93780671a23 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.506166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.506867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.507254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.507660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.508412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.510955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.531358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 919/1872] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:25.536028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.537772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:25.554378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f41d1-5413-4757-bf32-145683421d36 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.560936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.561625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.562101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.562443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.563294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.565206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.579698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 920/1873] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:25.587226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.602565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45fac6-bf05-4904-9f7e-f2872670af44 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.605689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.606445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.606733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.607012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.607767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.609444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.626753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 921/1874] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:25.626753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.628376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 954/1875] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:25.629249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.636529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa632-ec68-49c5-8bf5-72f7fdf67bb3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.693994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.696669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.696669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.696669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] PATH_INFO: `/v3/projects/e57fc9909e1d4f27a0b8d047458c8990/users/b6587754b52f4a398700efb35cbf2ebe/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.696915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed79f5-60c1-408d-b08b-fb128ae4a2a7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.701292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.702112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.702543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.702966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.703805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.706830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6b97d-fae9-4523-a062-e6fefc3640e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.710180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57fc9909e1d4f27a0b8d047458c8990, user_id=b6587754b52f4a398700efb35cbf2ebe, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.713646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.847188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 922/1876] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:25 2022] PUT /identity/v3/projects/e57fc9909e1d4f27a0b8d047458c8990/users/b6587754b52f4a398700efb35cbf2ebe/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:25.849934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 955/1877] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:25.852319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.859847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.860140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.860410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.888937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] MFA Rules not processed for user `b6587754b52f4a398700efb35cbf2ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:25.890140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:25.917682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e91ae-139d-4bc5-8cfc-aac504aa8990 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.922425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.922985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.923263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.923577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.924227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.925887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.939513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 923/1878] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:25.940575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.950899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2fab-04f5-47ff-9485-877eed79b7a3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.956464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.956602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 956/1879] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:25.957098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.957383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.957671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.958297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.959958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.961045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.971253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 924/1880] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:25.975336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:25.975567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247323-e6b7-4c6a-859b-dde711b0844a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.982729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.983680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.984156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.984591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:25.985711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:25.986478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d03e-401e-4dd1-91e7-2ba74a7a2f49 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:25.987878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f32c8-f29f-437b-810a-866a4f76231c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:25.991224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:25.991910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:25.992192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:25.992468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] PATH_INFO: `/v3/projects/a996b8bedfef498eb2c1ff1d51dd15b3/users/d7bc5b9daa1a40a9920bb230ebeeeb41/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.007561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a996b8bedfef498eb2c1ff1d51dd15b3, user_id=d7bc5b9daa1a40a9920bb230ebeeeb41, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.010826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.093246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:26.098684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 925/1881] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:25 2022] PUT /identity/v3/projects/a996b8bedfef498eb2c1ff1d51dd15b3/users/d7bc5b9daa1a40a9920bb230ebeeeb41/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:26.101410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 957/1882] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:25 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:26.107958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.109841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.110217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.110498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.139477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] MFA Rules not processed for user `d7bc5b9daa1a40a9920bb230ebeeeb41`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:26.140723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:26.202704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa033c-3734-44aa-87dd-483ac5a46a7e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.274488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 958/1883] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:26.275797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.275929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.276475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.276765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.277040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.277677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.279982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.300102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296534be-e8e6-4305-b157-625a6b58f2d7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.315752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.316392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.316683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.316989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.317639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.321089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.377536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 926/1884] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:26 2022] POST /identity/v3/users => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:26.390960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.405641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9529-5442-4e02-8cd3-c7dad91cb2cd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.411702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.412347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.412632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.412914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.413570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.415189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.434802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 959/1885] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:26.435760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.441805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 927/1886] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:26.449722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.459021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dad841-920d-4ecb-8df1-343320af5b0c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.528817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce993-cb10-4db3-a01a-2cf49d291676 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.535899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.536660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.536793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.537058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.537689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.539712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.569286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.569989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.570274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.570551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] PATH_INFO: `/v3/projects/cad023f7ba8246868672e0f83294a9f3/users/84337ca2337c49dbbecaf5ef58935e74/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.611732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad023f7ba8246868672e0f83294a9f3, user_id=84337ca2337c49dbbecaf5ef58935e74, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.611732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.687554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 960/1887] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:26 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:26.690600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.702844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f383-fcb9-4e04-bb98-29f9e3095438 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.708132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.708839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.709190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.710110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.710269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.712009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.731837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 928/1888] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:26 2022] PUT /identity/v3/projects/cad023f7ba8246868672e0f83294a9f3/users/84337ca2337c49dbbecaf5ef58935e74/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:26.736085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.756382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 961/1889] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:26.772695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.788300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe4d1-2f31-4c02-9e20-1926d607152f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.827114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bba50-0cc5-4867-b0c5-2d0759b4d5a1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.832585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.833352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.833703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.835600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.836689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.840835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.854605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 929/1890] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:26.860296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:26.872464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176b6c9-f92c-40a6-93be-bc3e6382cfc5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:26.878252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.878925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.879200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.879475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] PATH_INFO: `/v3/projects/cad023f7ba8246868672e0f83294a9f3/users/84337ca2337c49dbbecaf5ef58935e74/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.881436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad023f7ba8246868672e0f83294a9f3, user_id=84337ca2337c49dbbecaf5ef58935e74, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.884149 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ccbc-6352-4ee8-822a-c314f4dd59e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.910441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 930/1891] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:26 2022] PUT /identity/v3/projects/cad023f7ba8246868672e0f83294a9f3/users/84337ca2337c49dbbecaf5ef58935e74/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:26.910441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.910441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.910441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.929168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:26.929739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:26.930317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:26.930851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] PATH_INFO: `/v3/projects/04a8c94e912c4287a7506af89918ba09/users/e4dff1b862044536a57fe41d6c90d934/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:26.947323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a8c94e912c4287a7506af89918ba09, user_id=e4dff1b862044536a57fe41d6c90d934, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:26.950356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:26.960620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] MFA Rules not processed for user `84337ca2337c49dbbecaf5ef58935e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:26.962424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:27.021609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 962/1892] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:26 2022] PUT /identity/v3/projects/04a8c94e912c4287a7506af89918ba09/users/e4dff1b862044536a57fe41d6c90d934/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:27.022468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.075630 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 931/1893] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:27.084380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.085758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:27.115895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842840d-80ec-4ac3-b674-65122dd279e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.121443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.129837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.129837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.129837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.129837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.129837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.135433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 963/1894] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:27.139428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.148523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7e35-7d0e-4096-8c86-753cf09617d4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.148896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a0f3-fa0e-4ff0-b322-fa624c68f61d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.156065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.156727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.158764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.158764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] PATH_INFO: `/v3/projects/04a8c94e912c4287a7506af89918ba09/users/e4dff1b862044536a57fe41d6c90d934/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.159730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a8c94e912c4287a7506af89918ba09, user_id=e4dff1b862044536a57fe41d6c90d934, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.162374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650bdaa-ddc0-41ce-a487-b77a85a61d94 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.183402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 964/1895] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:27 2022] PUT /identity/v3/projects/04a8c94e912c4287a7506af89918ba09/users/e4dff1b862044536a57fe41d6c90d934/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:27.185258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.185918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.186210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.209492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.210251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.210605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.210950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.224910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] MFA Rules not processed for user `e4dff1b862044536a57fe41d6c90d934`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:27.226180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:27.279236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.280785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.290577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 932/1896] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:27.313889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 965/1897] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:27.321257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.323265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:27.339891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc663408-db35-4d83-a392-367a3e03fc07 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.403802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.404474 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.404762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.405044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.425418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.426861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.445524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 933/1898] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:27.446584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.525252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0da370-8ff9-4c16-a4d7-1f4549d6d4c2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.532488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.533409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.533701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.533985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] PATH_INFO: `/v3/users/b6587754b52f4a398700efb35cbf2ebe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.535177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6587754b52f4a398700efb35cbf2ebe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.537377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.596900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:27.608309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ad07-33ad-4b0e-a9cf-2c8e9a5d270b service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:27.612515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:27.613139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.613428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.613710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:27.707294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:27.710253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4584a7-db35-43af-909a-8903781bad39 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:27.721567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 934/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:27.832685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:27.850213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6587754b52f4a398700efb35cbf2ebe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:27.858877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6587754b52f4a398700efb35cbf2ebe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:27.859896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6587754b52f4a398700efb35cbf2ebe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:27.872690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6587754b52f4a398700efb35cbf2ebe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:27.873358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6587754b52f4a398700efb35cbf2ebe'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:27.984944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 966/1900] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:27 2022] DELETE /identity/v3/users/b6587754b52f4a398700efb35cbf2ebe => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:27.992196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:27.992677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:27.993152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:28.031212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:28.033530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:28.144992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 935/1901] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:28.158875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:28.168078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:28.231826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8191685-c496-416d-a45f-4b59c6b90507 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:28.235359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:28.236022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:28.236304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:28.236576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:28.246411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:28.250961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:28.257430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 967/1902] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:28.366451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:28.838208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:28.839853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:28.855472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b61ec-a03e-44d1-8517-7500146b578d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:28.861293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:28.862042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:28.862448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:28.862826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] PATH_INFO: `/v3/projects/e57fc9909e1d4f27a0b8d047458c8990` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:28.864448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57fc9909e1d4f27a0b8d047458c8990)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:28.885302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:29.002611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57fc9909e1d4f27a0b8d047458c8990', 'request_id': 'req-65083719-f6e7-4bcb-ad91-74fd17446c23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.011046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57fc9909e1d4f27a0b8d047458c8990', 'request_id': 'req-65083719-f6e7-4bcb-ad91-74fd17446c23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.106154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57fc9909e1d4f27a0b8d047458c8990', 'request_id': 'req-65083719-f6e7-4bcb-ad91-74fd17446c23'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.120953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] The token cache is being invalidate because project e57fc9909e1d4f27a0b8d047458c8990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:29.121340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.122086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.123905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 936/1903] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:28 2022] DELETE /identity/v3/projects/e57fc9909e1d4f27a0b8d047458c8990 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:29.128085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:29.138350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86ed3-b233-421e-8c76-1e4d1f536e71 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:29.219439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:29.220345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:29.220805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:29.221245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] PATH_INFO: `/v3/users/84337ca2337c49dbbecaf5ef58935e74` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:29.222622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84337ca2337c49dbbecaf5ef58935e74)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:29.225023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:29.434768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:29.436312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:29.448625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84337ca2337c49dbbecaf5ef58935e74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.451447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083719-f6e7-4bcb-ad91-74fd17446c23 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:29.456256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84337ca2337c49dbbecaf5ef58935e74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.457067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84337ca2337c49dbbecaf5ef58935e74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.457508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:29.458374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:29.459154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:29.459719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] PATH_INFO: `/v3/users/0454f307b0344b26901218129a119fb3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:29.461066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0454f307b0344b26901218129a119fb3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:29.463874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:29.470733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84337ca2337c49dbbecaf5ef58935e74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.471440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6a5311fa-6df1-44d2-bf86-8076dc3cc6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84337ca2337c49dbbecaf5ef58935e74'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:29.574832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 968/1904] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:29 2022] DELETE /identity/v3/users/84337ca2337c49dbbecaf5ef58935e74 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:30.039018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0454f307b0344b26901218129a119fb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.041790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0454f307b0344b26901218129a119fb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.061978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0454f307b0344b26901218129a119fb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.099620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0454f307b0344b26901218129a119fb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.192521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0454f307b0344b26901218129a119fb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.201809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 937/1905] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:29 2022] DELETE /identity/v3/users/0454f307b0344b26901218129a119fb3 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:30.206312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:30.207244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:30.207774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:30.230361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:30.235002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:30.307033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 969/1906] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:30.316905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:30.318417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:30.361531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:30.367052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:30.389255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1f179-01ae-49d9-9b29-a3ca1f8af8ee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:30.389488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ccbe6-2919-4cae-b21f-0cd18a800ef7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:30.392942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:30.393569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:30.393859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:30.394139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:30.394659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:30.395939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:30.396296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:30.396749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] PATH_INFO: `/v3/projects/cad023f7ba8246868672e0f83294a9f3` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:30.398091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad023f7ba8246868672e0f83294a9f3)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:30.401310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:30.407212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:30.409067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e47461-46d1-46f0-a58b-fd582154c68d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:30.422307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 938/1907] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:30.432338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:30.680906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad023f7ba8246868672e0f83294a9f3', 'request_id': 'req-bcea6f3d-7871-4422-8489-453e185cb80f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.688855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad023f7ba8246868672e0f83294a9f3', 'request_id': 'req-bcea6f3d-7871-4422-8489-453e185cb80f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.788732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad023f7ba8246868672e0f83294a9f3', 'request_id': 'req-bcea6f3d-7871-4422-8489-453e185cb80f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.802687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] The token cache is being invalidate because project cad023f7ba8246868672e0f83294a9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:30.803601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.805774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcea6f3d-7871-4422-8489-453e185cb80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:30.807614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 970/1908] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:30 2022] DELETE /identity/v3/projects/cad023f7ba8246868672e0f83294a9f3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:30.813000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:30.813479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:30.814012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:30.848184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:30.850584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:30.880378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:30.992292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 939/1909] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:31.000541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.001143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.001410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.024579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:31.029703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.060068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 971/1910] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:31.071895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.086930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6b3bc-aed0-4c63-97dc-b266217004e8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.094487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.095236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.095813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.096442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.097444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:31.098245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.100513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.116929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 940/1911] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:31.122224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.133981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c95a59-3714-4bf4-9cc0-f41023041f91 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.140205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.141430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.141941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.142423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.143267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.145631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.184563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.186425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.201774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365d43-027f-4538-9895-263044f7d215 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.208055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.208055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.208055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.208591 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] PATH_INFO: `/v3/users/d7bc5b9daa1a40a9920bb230ebeeeb41` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.209999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bc5b9daa1a40a9920bb230ebeeeb41)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.212141 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.297633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 972/1912] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:31 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:31.300087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.402326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cadec-2670-4bfb-a6ba-4c6a0b8c4457 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.412734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.414302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.414802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.416575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.417531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.419724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.460176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bc5b9daa1a40a9920bb230ebeeeb41'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.461986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bc5b9daa1a40a9920bb230ebeeeb41'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.474335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bc5b9daa1a40a9920bb230ebeeeb41'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.488982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bc5b9daa1a40a9920bb230ebeeeb41'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.543321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 973/1913] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:31 2022] POST /identity/v3/users => generated 305 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:31.543595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.545295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.560873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bc5b9daa1a40a9920bb230ebeeeb41'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.563419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e2641-7a91-49e7-a39a-78ce9db169bb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.567980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 941/1914] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:31 2022] DELETE /identity/v3/users/d7bc5b9daa1a40a9920bb230ebeeeb41 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:31.569107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.573741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.579788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.579788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.579788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.579788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] PATH_INFO: `/v3/projects/0e4b67180f864ca2a5650c60f794458f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.580372 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4b67180f864ca2a5650c60f794458f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.581239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.687742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beed50-da49-4daa-bf49-c99a96409e14 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.692719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.693367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.698479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.698479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.698479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.698479 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c313-b555-4b0e-95f3-368bf3078263 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.707723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 942/1915] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:31.709261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.709995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.710657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.744892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:31.744892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.772698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4b67180f864ca2a5650c60f794458f', 'request_id': 'req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.779938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4b67180f864ca2a5650c60f794458f', 'request_id': 'req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.821944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 943/1916] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:31.823824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.835200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f536-073f-4983-ab3b-8c69a8cb3b75 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.842795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.847734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.847734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.847734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.847734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.847734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.859978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 944/1917] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:31.861194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.863044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.899455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4b67180f864ca2a5650c60f794458f', 'request_id': 'req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.924107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] The token cache is being invalidate because project 0e4b67180f864ca2a5650c60f794458f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:31.925648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.925648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:31.930200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 974/1918] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:31 2022] DELETE /identity/v3/projects/0e4b67180f864ca2a5650c60f794458f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:31.939552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:31.943300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.948595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a91c1-82f6-4aa1-90d9-d426122d617b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.953309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.954255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.954730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.955208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.957611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:31.962155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5d7b-a505-45ad-8783-7e86e3fe17a0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:31.969123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:31.969934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:31.970221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:31.970554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] PATH_INFO: `/v3/projects/3e356a68fb104acea1acf4670eba897d/users/38da22680b3843c88e0dd419b269ed78/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:31.987077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.988681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:31.991117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e356a68fb104acea1acf4670eba897d, user_id=38da22680b3843c88e0dd419b269ed78, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:31.995660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa1011-49c8-4924-8ffb-220559ef5474 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:32.001776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 945/1919] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:32.003080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:32.004633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:32.019947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2030d2-f614-4076-96e1-f2d5e90ed6cb service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:32.026808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:32.027707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:32.028002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:32.028280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] PATH_INFO: `/v3/users/495cc81635504b75b29488069f5ddc70` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:32.029587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495cc81635504b75b29488069f5ddc70)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:32.031666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:32.105549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 975/1920] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:31 2022] PUT /identity/v3/projects/3e356a68fb104acea1acf4670eba897d/users/38da22680b3843c88e0dd419b269ed78/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:32.114289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:32.114955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:32.115651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:32.151990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] MFA Rules not processed for user `38da22680b3843c88e0dd419b269ed78`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:32.154268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:32.257312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 976/1921] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:32 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:32.261504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:32.281678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495cc81635504b75b29488069f5ddc70'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:32.283784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495cc81635504b75b29488069f5ddc70'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:32.295692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495cc81635504b75b29488069f5ddc70'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:32.312073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495cc81635504b75b29488069f5ddc70'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:32.365204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851406-fc2c-48b7-a3c2-79c912d5282a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:32.373215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:32.377483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:32.377483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:32.377483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:32.377483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:32.377483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:32.422829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495cc81635504b75b29488069f5ddc70'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:32.429840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 946/1922] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:32 2022] DELETE /identity/v3/users/495cc81635504b75b29488069f5ddc70 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:32.524728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 977/1923] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:32 2022] POST /identity/v3/projects => generated 409 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:32.526760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:32.528492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:32.635822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01265-138d-43ee-be42-5e8b6695b5b9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:32.728354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:32.731179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:32.731693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:32.732978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:32.734117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:32.736644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:32.925200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 947/1924] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:32 2022] POST /identity/v3/users => generated 311 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:32.929220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:32.941878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b59d7-961a-4ad8-bc68-c0237dcc94b4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:32.952927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:32.953508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:32.954015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:32.954307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:32.954982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:32.957264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:32.971772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 978/1925] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:32.981982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:32.994729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7924-f5f8-454d-8e2b-5e0b1d173d25 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.000079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.000623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.001304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.001304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] PATH_INFO: `/v3/projects/4831d449f7c74ec39fcaf109b5ea0035/users/c2e97953ab864d6997b56a2a5c46bbf1/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.009578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.018670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.036504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4831d449f7c74ec39fcaf109b5ea0035, user_id=c2e97953ab864d6997b56a2a5c46bbf1, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.039726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.048756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89516-6d35-4b9f-b755-c54f8905bdba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.060550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.061664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.062018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.062368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] PATH_INFO: `/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.064411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cae2bd0ca741d5ab70f37d04998fd6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.067040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.120859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 948/1926] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:32 2022] PUT /identity/v3/projects/4831d449f7c74ec39fcaf109b5ea0035/users/c2e97953ab864d6997b56a2a5c46bbf1/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:33.125374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.209911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714744-5d7a-446d-b3aa-12a661ee3a08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.215886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.216602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.217043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.217164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.217886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.219842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.234421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 949/1927] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:33.235744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.239177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.256795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cae2bd0ca741d5ab70f37d04998fd6', 'request_id': 'req-5ba039aa-84af-406b-82cd-b13fb19b7d7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.259098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026512e-cc74-4ee2-a557-4db22a784da9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.263226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cae2bd0ca741d5ab70f37d04998fd6', 'request_id': 'req-5ba039aa-84af-406b-82cd-b13fb19b7d7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.266998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:33.328107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.328797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.329036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.329322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] PATH_INFO: `/v3/projects/a996b8bedfef498eb2c1ff1d51dd15b3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.330500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a996b8bedfef498eb2c1ff1d51dd15b3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.332471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.340916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cae2bd0ca741d5ab70f37d04998fd6', 'request_id': 'req-5ba039aa-84af-406b-82cd-b13fb19b7d7a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.363762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] The token cache is being invalidate because project 60cae2bd0ca741d5ab70f37d04998fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:33.364219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.367594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.367594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 979/1928] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:33 2022] DELETE /identity/v3/projects/60cae2bd0ca741d5ab70f37d04998fd6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:33.367594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.370870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.385152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba039aa-84af-406b-82cd-b13fb19b7d7a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.390565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.391234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.391595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.391938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] PATH_INFO: `/v3/projects/4831d449f7c74ec39fcaf109b5ea0035/users/c2e97953ab864d6997b56a2a5c46bbf1/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.394540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4831d449f7c74ec39fcaf109b5ea0035, user_id=c2e97953ab864d6997b56a2a5c46bbf1, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.398455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21b76c-1b8e-4309-a992-ff29907dbd84 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.411757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 980/1929] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:33 2022] PUT /identity/v3/projects/4831d449f7c74ec39fcaf109b5ea0035/users/c2e97953ab864d6997b56a2a5c46bbf1/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:33.413698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1436-5860-4ee2-840c-4bd0ab5d4660 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.414121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1436-5860-4ee2-840c-4bd0ab5d4660 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.414539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1436-5860-4ee2-840c-4bd0ab5d4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.437899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-19bb1436-5860-4ee2-840c-4bd0ab5d4660 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:33.439129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-19bb1436-5860-4ee2-840c-4bd0ab5d4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.470008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a996b8bedfef498eb2c1ff1d51dd15b3', 'request_id': 'req-0a4605a1-fa41-4860-b568-a557aa3bb127'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.476848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a996b8bedfef498eb2c1ff1d51dd15b3', 'request_id': 'req-0a4605a1-fa41-4860-b568-a557aa3bb127'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.484408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:33.504968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 981/1930] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:33.511768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.511768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.511768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.538142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] MFA Rules not processed for user `c2e97953ab864d6997b56a2a5c46bbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:33.539412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.582895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a996b8bedfef498eb2c1ff1d51dd15b3', 'request_id': 'req-0a4605a1-fa41-4860-b568-a557aa3bb127'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.596258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] The token cache is being invalidate because project a996b8bedfef498eb2c1ff1d51dd15b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:33.596600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.597198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0a4605a1-fa41-4860-b568-a557aa3bb127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.601624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 950/1931] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:33 2022] DELETE /identity/v3/projects/a996b8bedfef498eb2c1ff1d51dd15b3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:33.601624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.601624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.601624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.618083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 982/1932] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:33.618083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.618083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.632043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:33.633512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.701622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e3f7-c56c-47b7-a980-7a3a9d555a7c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.706782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.707498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.707801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.708081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] PATH_INFO: `/v3/users/e4dff1b862044536a57fe41d6c90d934` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.709285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4dff1b862044536a57fe41d6c90d934)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.711807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.718596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 951/1933] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:33.718596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.718596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.766488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:33.781567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fafcb4-33c4-4cce-8165-12421444ac00 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.786510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.787299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.787712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.788067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.790041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:33.803218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.804742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.815649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 952/1934] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:33.816456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.827676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0339-636b-4138-8559-2bc3292fa8d2 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.833884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.834770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.835193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.835662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.836492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:33.836938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.839462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.852545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 953/1935] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:33.857946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:33.878182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59142-97a5-4e9f-8617-9ad39cd1f4a0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:33.884121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:33.886270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:33.886270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:33.898697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:33.904094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:33.904729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:33.931938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4dff1b862044536a57fe41d6c90d934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.961002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4dff1b862044536a57fe41d6c90d934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.964985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4dff1b862044536a57fe41d6c90d934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.991242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4dff1b862044536a57fe41d6c90d934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:33.993127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4dff1b862044536a57fe41d6c90d934'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:34.075862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 983/1936] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:33 2022] DELETE /identity/v3/users/e4dff1b862044536a57fe41d6c90d934 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:34.082185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 954/1937] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:33 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:34.083952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.088890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:34.251941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068925bf-350f-4d41-9c5f-eb7b92857e76 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.376135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.377964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:34.382531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.383750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.384286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.385593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.386622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.389210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.494830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46ec12-2f3c-4f3c-b73c-ad52cc5a54b0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.495896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 984/1938] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:34 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:34.503296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.504195 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.504534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.505057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.507198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:34.514695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.548541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3643aa-3c6c-4dfd-a0b0-2bb7b427883c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.564243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.565036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.565383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.565755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.568958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.570796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.590767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.592402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.601229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 985/1939] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:34.603174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.606261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 955/1940] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:34.618759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919efc-df7c-472e-8058-1462b50fcc3f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.628958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.631471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.633699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.636611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.637615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.640226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.654881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 986/1941] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:34.660421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.670638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858fa25-67fc-438a-8d8a-c2c8dfab4073 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.675783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.676442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.676729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.677012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] PATH_INFO: `/v3/projects/a6e30dddc46549f299c4c533f182527c/users/4a45a5249ed24e5a9bb52d2b519cedd2/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.708860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e30dddc46549f299c4c533f182527c, user_id=4a45a5249ed24e5a9bb52d2b519cedd2, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.724866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.726681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eb8d5-0788-4d03-9c44-69be0864a153 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.727036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:34.785083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728fa8-e480-49ae-a931-08030ab2c010 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:34.790295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:34.791154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.791616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.791976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] PATH_INFO: `/v3/projects/04a8c94e912c4287a7506af89918ba09` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.793223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a8c94e912c4287a7506af89918ba09)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:34.795214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:34.832507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 956/1942] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:34 2022] PUT /identity/v3/projects/a6e30dddc46549f299c4c533f182527c/users/4a45a5249ed24e5a9bb52d2b519cedd2/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:34.843145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:34.843433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:34.843747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:34.884988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] MFA Rules not processed for user `4a45a5249ed24e5a9bb52d2b519cedd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:34.886265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:34.923268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a8c94e912c4287a7506af89918ba09', 'request_id': 'req-7277fd43-f930-4c71-b7be-cce2d7367184'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:34.929278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a8c94e912c4287a7506af89918ba09', 'request_id': 'req-7277fd43-f930-4c71-b7be-cce2d7367184'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:34.954728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 957/1943] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:34.959354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:34.989223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:35.026696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0566f1c-9cfb-4c30-899d-81bf5859a684 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.049214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a8c94e912c4287a7506af89918ba09', 'request_id': 'req-7277fd43-f930-4c71-b7be-cce2d7367184'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:35.061728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] The token cache is being invalidate because project 04a8c94e912c4287a7506af89918ba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:35.062107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:35.062844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7277fd43-f930-4c71-b7be-cce2d7367184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:35.064636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 987/1944] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:34 2022] DELETE /identity/v3/projects/04a8c94e912c4287a7506af89918ba09 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:35.069414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a26465-aec6-4b78-b975-d6b563a11682 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.069698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a26465-aec6-4b78-b975-d6b563a11682 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.070006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a26465-aec6-4b78-b975-d6b563a11682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.087252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.087252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.087252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.087252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.087767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.089416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.093812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e6a26465-aec6-4b78-b975-d6b563a11682 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:35.095221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e6a26465-aec6-4b78-b975-d6b563a11682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.104347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 988/1945] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:35.112050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.119762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.119762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.132358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:35.133533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.141530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 989/1946] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:35.145527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.154243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc9c5-3862-4070-92c2-811061848817 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.159163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.159781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.160066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.160341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.160985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:35.161291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.162886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.174977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 990/1947] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:35.179129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.188933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7ad6-d2f5-4816-92f9-ffa9e43aa512 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.193421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.193976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.194263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.194606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.195212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.197180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.220598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 958/1948] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:34 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:35.221544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.232092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.299456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3e362-e448-4f0c-9f3b-6d2d930c7424 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.304190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.304819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.305109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.305385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.306019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.308310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.344771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 991/1949] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:35.349168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.423662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 959/1950] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:35.423662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.433696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0884-9222-4347-a3ae-185f59c6bb67 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.440490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.441243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.441670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.442065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.442931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.444108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5510-ce43-4d17-9c45-355395c7f2c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.444941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.451793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.452765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.453441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.454018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.454967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.458104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.464163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 960/1951] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:35.465637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.498393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75074038-3ef3-4aba-b2da-7fde8c78e84f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.505285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.506860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.507156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.507436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] PATH_INFO: `/v3/projects/4d061e2cd2f041658aac43dcb9439530/users/b2fc493b28c343eca47abd7ada40ad5e/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.540704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d061e2cd2f041658aac43dcb9439530, user_id=b2fc493b28c343eca47abd7ada40ad5e, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.544239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.583224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 992/1952] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:35.587043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.597158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178044-de65-457b-8449-7aa4a8d18064 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.602888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.604353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.604975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.605440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.607205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:35.607861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.609634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.622156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 993/1953] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:35.626321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.629554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 961/1954] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:35 2022] PUT /identity/v3/projects/4d061e2cd2f041658aac43dcb9439530/users/b2fc493b28c343eca47abd7ada40ad5e/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:35.635038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.640903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3036cc-9ebb-4367-98aa-a8aa4b53a491 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.701027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f8d8-df64-4492-8eda-a4939b855211 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.706705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.707708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.708005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.708267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.708402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.708859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.709021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.709182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.709520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.710080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.710848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.711873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.722629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 962/1955] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:35.723650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 994/1956] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:35.726710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.728680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.739622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112b688-5b93-4743-931c-08d86400497c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.741847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c05e-568f-4f97-a9ae-ab01cb0850c3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:35.746644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.747570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.747706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:35.747869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.748145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] PATH_INFO: `/v3/projects/4bb7dee3754940e8a6e62a991856ba56/users/bfe8489bb37043d5b768addf67479a99/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.748613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.748936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.749183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] PATH_INFO: `/v3/projects/4d061e2cd2f041658aac43dcb9439530/users/b2fc493b28c343eca47abd7ada40ad5e/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.751162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d061e2cd2f041658aac43dcb9439530, user_id=b2fc493b28c343eca47abd7ada40ad5e, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.754037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f75b-8214-49b4-b8bf-bd540a12c156 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.764075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb7dee3754940e8a6e62a991856ba56, user_id=bfe8489bb37043d5b768addf67479a99, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:35.767378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265377c8-5bfa-4f6d-a878-0fbe4aca77b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:35.771564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 963/1957] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:35 2022] PUT /identity/v3/projects/4d061e2cd2f041658aac43dcb9439530/users/b2fc493b28c343eca47abd7ada40ad5e/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:35.778790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.779080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.779357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.810747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] MFA Rules not processed for user `b2fc493b28c343eca47abd7ada40ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:35.812062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.885306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 995/1958] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:35 2022] PUT /identity/v3/projects/4bb7dee3754940e8a6e62a991856ba56/users/bfe8489bb37043d5b768addf67479a99/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:35.887510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 964/1959] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:35.895008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:35.895399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:35.895795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:35.903860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:35.906121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.934991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] MFA Rules not processed for user `bfe8489bb37043d5b768addf67479a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:35.936461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:35.991716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9edd-927a-4bf8-8526-5fbd727369a8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.019989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 996/1960] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:36.025772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.059036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.059789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.062876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.062876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.109194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfd00-a27e-4764-aa49-c155681c0bf6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.114087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.114771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.115122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.115524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.116232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.118223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.129830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.131716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.142873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 965/1961] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:36.252784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 997/1962] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:36.257071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.267900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcfc8-d80e-445f-a386-bf19d55d72b2 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.274044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:36.332974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.333597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.333879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.334150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.334793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.336746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.401392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.453366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 966/1963] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:36 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:36.457075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.463641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da05fb2-802e-4052-98a2-281148fed6d1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.467455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.468108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.468386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.468663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.469321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9764a3-dbea-4e51-9088-0e4605fd1a0f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.470421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:36.474490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.475277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.475774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.476198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.477002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.479045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.489742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 967/1964] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:36.494080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.504796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794dd0b-a296-42f5-af94-671e073204a8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.511333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.512164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.512553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.512920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] PATH_INFO: `/v3/projects/e04120c8f5f4475f83c064b19382e749/users/80096886a568449b8592ee23ff79e5c7/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.530492 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04120c8f5f4475f83c064b19382e749, user_id=80096886a568449b8592ee23ff79e5c7, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.533589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.539197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.541047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.551894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 998/1965] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:36.600098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 968/1966] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:36 2022] PUT /identity/v3/projects/e04120c8f5f4475f83c064b19382e749/users/80096886a568449b8592ee23ff79e5c7/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:36.604150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.614950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bf42-83ed-46c3-89dd-d6757a102e93 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.670093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.670696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.670976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.671249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.671922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.673530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466940e-9278-4ea2-9db3-d64093a12701 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.683997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 999/1967] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:36.688336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:36.698252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:36.699440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21704-6aa7-445f-a8e1-cc71abb81237 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:36.704598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:36.706976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.706976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.706976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] PATH_INFO: `/v3/projects/e04120c8f5f4475f83c064b19382e749/users/80096886a568449b8592ee23ff79e5c7/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.708995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04120c8f5f4475f83c064b19382e749, user_id=80096886a568449b8592ee23ff79e5c7, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:36.712343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:36.725279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 969/1968] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:36 2022] PUT /identity/v3/projects/e04120c8f5f4475f83c064b19382e749/users/80096886a568449b8592ee23ff79e5c7/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:36.736878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:36.737248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:36.737627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:36.769081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] MFA Rules not processed for user `80096886a568449b8592ee23ff79e5c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:36.772463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:36.847179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1000/1969] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:37.007374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:37.063551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdce1-ead3-4d15-a56a-0e1a11bd4ba3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:37.067196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:37.067871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:37.068153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:37.068430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:37.077783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:37.079209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1a58-1123-4733-82fd-5b746eac58cf service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:37.089226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 970/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:37.406505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:37.408258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:37.496477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4470-8ec8-429d-adbd-2a9c18592888 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:37.503271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:37.507933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:37.510632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:37.510632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:37.510632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] PATH_INFO: `/v3/users/19637a8c059c44148ad50baf3c3feb6a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:37.511870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19637a8c059c44148ad50baf3c3feb6a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:37.514999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:37.702899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19637a8c059c44148ad50baf3c3feb6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:37.709785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19637a8c059c44148ad50baf3c3feb6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:37.710457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19637a8c059c44148ad50baf3c3feb6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:37.722454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19637a8c059c44148ad50baf3c3feb6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:37.723128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19637a8c059c44148ad50baf3c3feb6a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:37.803976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1001/1971] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:37 2022] DELETE /identity/v3/users/19637a8c059c44148ad50baf3c3feb6a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:37.809561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:37.809847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:37.810277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:37.819765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:37.821536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:37.832541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:37.833733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:37.893612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335308-e0d3-4b76-bff5-68058fde1c6f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:37.896235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 971/1972] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:37.900792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:37.901432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:37.901714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:37.901995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] PATH_INFO: `/v3/users/bfe8489bb37043d5b768addf67479a99` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:37.903268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe8489bb37043d5b768addf67479a99)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:37.905297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:37.906021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:37.907527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:37.965926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a01d-20df-4ff7-a9c6-514c0d28f6a6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:37.969424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:37.970062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:37.970451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:37.970618 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:37.980179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:37.981626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21be9-a5c0-4241-8162-6d902dd50338 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:37.991221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 972/1973] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:38.139181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe8489bb37043d5b768addf67479a99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.148057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe8489bb37043d5b768addf67479a99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.148778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe8489bb37043d5b768addf67479a99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.163384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe8489bb37043d5b768addf67479a99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.168131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe8489bb37043d5b768addf67479a99'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.257210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1002/1974] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:37 2022] DELETE /identity/v3/users/bfe8489bb37043d5b768addf67479a99 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:38.263635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.264133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.265037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.292288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:38.293606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:38.370935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 973/1975] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:38.381021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:38.383535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:38.430057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:38.431898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:38.459276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6321-d9c1-4b7e-a0e9-d44d46d4e114 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:38.473695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:38.474562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.475193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.475193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] PATH_INFO: `/v3/projects/6d5d8daa0384490ca0ac7fe69545c6ed` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.484792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5d8daa0384490ca0ac7fe69545c6ed)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:38.484792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:38.520137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5252ac-b817-435a-b6a2-cfe8d0831c76 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:38.528508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:38.529692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.531285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.532385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.555577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:38.557146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be75c-e6a6-4b5a-9bc9-78d6194c10d1 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:38.567688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1003/1976] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:38.660940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5d8daa0384490ca0ac7fe69545c6ed', 'request_id': 'req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.672986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5d8daa0384490ca0ac7fe69545c6ed', 'request_id': 'req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.726312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:38.762588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5d8daa0384490ca0ac7fe69545c6ed', 'request_id': 'req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.778758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] The token cache is being invalidate because project 6d5d8daa0384490ca0ac7fe69545c6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:38.779057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.779899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3d9ac727-c11d-48fe-a8b7-5035cd8eb0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:38.781723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 974/1977] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:38 2022] DELETE /identity/v3/projects/6d5d8daa0384490ca0ac7fe69545c6ed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:38.787849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.788275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.788707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.824395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:38.825838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:38.923265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1004/1978] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:38.932515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.932872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.933162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.963118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:38.964620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:38.973704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 975/1979] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:38.977867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:38.988579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17629a-5adb-41ee-9888-6b2d336d3af4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:38.993557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:38.994254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:38.994602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:38.997437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:38.997437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:38.997437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:38.997810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.015006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1005/1980] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:39.016786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.027562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9dbfa-778b-43fa-9d6d-5e02692e51e6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.033265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.033878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.034157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.034429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.035062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.037133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.132780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.136953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:39.150734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585ae4-c32d-46a2-b219-93aa1e5a6553 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.154930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:39.164810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 976/1981] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:39 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:39.170154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.171470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.172161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.174984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.175269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] PATH_INFO: `/v3/projects/4bb7dee3754940e8a6e62a991856ba56` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.178948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb7dee3754940e8a6e62a991856ba56)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.180942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.251124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa68f0-e039-4cd0-8658-bf0850f05aa5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.255816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.256433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.256713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.256984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.257605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.259682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.315634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb7dee3754940e8a6e62a991856ba56', 'request_id': 'req-a6d8650c-2feb-44f9-b4e6-e50940216795'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.321783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb7dee3754940e8a6e62a991856ba56', 'request_id': 'req-a6d8650c-2feb-44f9-b4e6-e50940216795'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.335330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 977/1982] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:39 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:39.340212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.358428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3b9f9-6843-4579-a522-dfefb6a710bc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.394464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb7dee3754940e8a6e62a991856ba56', 'request_id': 'req-a6d8650c-2feb-44f9-b4e6-e50940216795'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.419645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] The token cache is being invalidate because project 4bb7dee3754940e8a6e62a991856ba56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:39.419992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.420964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.426570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1006/1983] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:39 2022] DELETE /identity/v3/projects/4bb7dee3754940e8a6e62a991856ba56 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:39.427876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.431717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:39.437658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.438562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.438912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.439636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.440427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.442283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.459338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8650c-2feb-44f9-b4e6-e50940216795 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.463440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 978/1984] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:39.465565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.465716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.466358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.466792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.466944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] PATH_INFO: `/v3/users/80096886a568449b8592ee23ff79e5c7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.468098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:39.474874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=80096886a568449b8592ee23ff79e5c7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.474874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.482116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8d6d0-5c18-45c7-9c2b-440764f7c6f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.486927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.487710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.488093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.488462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.489212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.490913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.510331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 979/1985] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:39.513788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.524660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae171e-ec7f-4998-a3f5-52fa9a184b26 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.535607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.535607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.535607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.535607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] PATH_INFO: `/v3/projects/142a440a15d44fbfa4150bf044f346bf/users/44506bca7e0a44849dcd71bdcdbdd747/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.555456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142a440a15d44fbfa4150bf044f346bf, user_id=44506bca7e0a44849dcd71bdcdbdd747, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.558340 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884128b-1d56-4653-bd20-46c62abf4953 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:39.711864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 980/1986] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:39 2022] PUT /identity/v3/projects/142a440a15d44fbfa4150bf044f346bf/users/44506bca7e0a44849dcd71bdcdbdd747/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:39.724302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.724597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.724996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.732929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80096886a568449b8592ee23ff79e5c7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.739805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80096886a568449b8592ee23ff79e5c7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.740485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80096886a568449b8592ee23ff79e5c7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.752662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80096886a568449b8592ee23ff79e5c7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.753357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80096886a568449b8592ee23ff79e5c7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:39.753465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] MFA Rules not processed for user `44506bca7e0a44849dcd71bdcdbdd747`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:39.754681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:39.821653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 981/1987] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:39.823149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1007/1988] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:39 2022] DELETE /identity/v3/users/80096886a568449b8592ee23ff79e5c7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:39.830115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:39.831669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:39.902440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ce9-e7d5-49c4-b9b6-5b7d21f34475 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:39.966934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:39.967647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:39.967932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:39.968207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:39.968832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:39.970762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.185968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 982/1989] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:40.190000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.201797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b825-f8f6-4455-9d5d-25ff1a1847ab admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.258426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.259034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.259953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.260511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.261057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.263016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.333844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.335657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:40.351801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1044f-9605-40af-a4c4-3cdbf8fa21b5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.365194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.365194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.365194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.365194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] PATH_INFO: `/v3/projects/e04120c8f5f4475f83c064b19382e749` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.366205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04120c8f5f4475f83c064b19382e749)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.366921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.368557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1008/1990] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:40.372829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.383042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778f1-8f5e-4f9f-b230-51999f41e60a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.388805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.389409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.389695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.389974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.391013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.392359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.403242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1009/1991] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:40.407161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.417612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654a04-87d6-4f69-a423-6d837dd6b1e4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.422280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.422859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.423141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.423417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.424110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.425736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.437919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1010/1992] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:40.441750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.451828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6a5b-edfa-42fe-826d-a9b21f9bde0c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.456896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.457542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.457829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.458107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] PATH_INFO: `/v3/projects/65819b9fa51c4529b2829315dc92a773/users/5bf795b1a1ed4467a3f9ea283c2c8e15/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.473343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65819b9fa51c4529b2829315dc92a773, user_id=5bf795b1a1ed4467a3f9ea283c2c8e15, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.476627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35b9d-564c-4aa6-9021-49105967d565 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.585060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1011/1993] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:40 2022] PUT /identity/v3/projects/65819b9fa51c4529b2829315dc92a773/users/5bf795b1a1ed4467a3f9ea283c2c8e15/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:40.585395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04120c8f5f4475f83c064b19382e749', 'request_id': 'req-ca3e399f-cc87-4015-8f30-fc97792437d3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:40.587236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.587707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.587913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.592239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04120c8f5f4475f83c064b19382e749', 'request_id': 'req-ca3e399f-cc87-4015-8f30-fc97792437d3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:40.615435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] MFA Rules not processed for user `5bf795b1a1ed4467a3f9ea283c2c8e15`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:40.616660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:40.668511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04120c8f5f4475f83c064b19382e749', 'request_id': 'req-ca3e399f-cc87-4015-8f30-fc97792437d3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:40.682784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1012/1994] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:40.687379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.705824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] The token cache is being invalidate because project e04120c8f5f4475f83c064b19382e749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:40.706150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:40.707381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ca3e399f-cc87-4015-8f30-fc97792437d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:40.709497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 983/1995] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:40 2022] DELETE /identity/v3/projects/e04120c8f5f4475f83c064b19382e749 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:40.718059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f2bbb-3115-4ca4-b3b3-80bf11a2779e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.719034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f2bbb-3115-4ca4-b3b3-80bf11a2779e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.719319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f2bbb-3115-4ca4-b3b3-80bf11a2779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.746904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-819f2bbb-3115-4ca4-b3b3-80bf11a2779e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:40.748707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-819f2bbb-3115-4ca4-b3b3-80bf11a2779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:40.765657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 984/1996] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:40.770910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2daee-2a3a-48a8-9f46-b633d5b3d0a2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.774565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.775326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.776454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.778762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.779402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.779722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.780010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.780654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.783426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.799402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:40.807632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:40.809042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:40.817595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 985/1997] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:40.821846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.831805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ce914-74c3-45c1-9012-8a4f01610cb2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.836504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.837072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.837374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.837706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.838678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:40.839026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.840647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.852109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 986/1998] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:40.856828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.866593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e804f2-89d1-4248-ad54-03245f9e657c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.872086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.872685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.872966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.873235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.873890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.875837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.879635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1013/1999] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:40.880607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:40.882227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:40.946557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338e6a-ff2b-4d56-84bb-93ea2abb69bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:40.951923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:40.952641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:40.952851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:40.953126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:40.953807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:40.955788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:40.964880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 987/2000] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:40.965782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.030887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918109c-1d9c-49c7-93ef-863b2f1da973 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.036068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.036686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.036972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.037252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.037951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.039916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.161185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 988/2001] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:41.162166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1014/2002] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:40 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:41.165989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.166355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.176907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc900f-7dee-43df-b0c6-2dc776e506d5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.177063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b71c-1b07-4360-a6ab-0a4b15d89f37 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.182402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.189749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.189879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.189879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.190183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.190276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.190347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.190347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.190516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.190599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.190668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.190736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.196221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1015/2003] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:41.201249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 989/2004] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:41.201382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.202250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.211146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a967-4a79-4fa4-b7b6-393d81c8e84a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.213807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79bc17-08f0-4465-8daa-8d88d8f09948 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.218700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.219110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.219442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.219771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.219948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.220041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.220197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.220605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] PATH_INFO: `/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f/users/7c6aae5aef464497b30bf13fff97601a/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.220700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.223516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.234192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 990/2005] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:41.237317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04572f1c8d284fb29f2b1279dbd7fa9f, user_id=7c6aae5aef464497b30bf13fff97601a, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.238537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.240296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.247250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:41.248502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e84252-e240-4bc8-a98f-dae5fdbb9506 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.253760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.255655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.255655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.255655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] PATH_INFO: `/v3/projects/92daa7cda7144b2ba1d10c6cd3407b19/users/60e561f003ef43d1909ffdd415257fff/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.273065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92daa7cda7144b2ba1d10c6cd3407b19, user_id=60e561f003ef43d1909ffdd415257fff, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.276442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177ae8-5eee-462e-9ea8-207f879f3407 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.352130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1016/2006] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:41 2022] PUT /identity/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f/users/7c6aae5aef464497b30bf13fff97601a/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:41.356557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.375203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 991/2007] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:41 2022] PUT /identity/v3/projects/92daa7cda7144b2ba1d10c6cd3407b19/users/60e561f003ef43d1909ffdd415257fff/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:41.380240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.380535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.380820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.399634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:41.401515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:41.422163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c16b-33e9-4e93-b755-a5401ef56731 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.467929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 992/2008] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:41.477837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.479926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:41.489749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.490335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.490623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.490905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.491682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.493247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.504027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1017/2009] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:41.508239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.518317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13408eea-1f3b-4927-98da-2a93c3ca8add admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.523110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.523794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.524102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.524373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] PATH_INFO: `/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f/users/7c6aae5aef464497b30bf13fff97601a/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.526931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04572f1c8d284fb29f2b1279dbd7fa9f, user_id=7c6aae5aef464497b30bf13fff97601a, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.529811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feb00d-b896-43f8-8987-b06baf14f018 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.541360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1018/2010] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:41 2022] PUT /identity/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f/users/7c6aae5aef464497b30bf13fff97601a/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:41.547316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acda47-6c5f-4638-aa5e-462d91b280d0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.552523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.552813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.553101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.582263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] MFA Rules not processed for user `7c6aae5aef464497b30bf13fff97601a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:41.583642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:41.597001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.597580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.597866 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.598146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.628362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:41.662542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1019/2011] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:41.664759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.666702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.670696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:41.672132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:41.676931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 993/2012] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:41.730995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e19f9-99d6-4750-b8e5-4eb30507ea03 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:41.734674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:41.735287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:41.735600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:41.735909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:41.737696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:41.798310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:41.799853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cc510-ead0-4d10-ad8a-bf0187424441 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:41.817013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1020/2013] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:42.690829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:42.692545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:42.706385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0f99b-8d67-49a6-b1cc-a5a1807302b1 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:42.711335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:42.712016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:42.712333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:42.713466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] PATH_INFO: `/v3/users/38da22680b3843c88e0dd419b269ed78` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:42.716083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38da22680b3843c88e0dd419b269ed78)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:42.716910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:43.211227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38da22680b3843c88e0dd419b269ed78'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:43.212023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38da22680b3843c88e0dd419b269ed78'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:43.219831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38da22680b3843c88e0dd419b269ed78'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:43.233722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38da22680b3843c88e0dd419b269ed78'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:43.311803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.313151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.313623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.322690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-1c92c8fd-aca8-4074-83d5-fd33b3ac01d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38da22680b3843c88e0dd419b269ed78'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:43.336800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 994/2014] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:42 2022] DELETE /identity/v3/users/38da22680b3843c88e0dd419b269ed78 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:43.341308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.341610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.342084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.371363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:43.371868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] MFA Rules not processed for user `60e561f003ef43d1909ffdd415257fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:43.373491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:43.384007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:43.467933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1021/2016] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:43.473641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 995/2016] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:43.474199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:43.474199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:43.479924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:43.492087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:43.492680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18f5e8-b229-4856-a7f5-100b8860348d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:43.501272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:43.501962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.502248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.502524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.503206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:43.505182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:43.581504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f7e6-0c08-4a5a-b482-f4f5990c0148 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:43.585351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:43.585972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.586253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.586521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.598500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:43.600063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:43.612090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 996/2017] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:43.681785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1022/2018] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:43 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:43.695892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:43.695892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d218-2907-4fbd-8246-6b8e114220a0 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:43.778722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:43.779349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.779693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.779974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.780612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:43.782626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:43.823812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:43.911351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 997/2019] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:43 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:43.916218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:43.927683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5240-768a-415a-9d5b-de3f833b5126 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:43.934446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:43.935130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.935378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.935858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:43.943535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:43.943535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:43.953875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1023/2020] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:43.963564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:43.978400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1b1e-8a63-45db-bf96-ab1668ccb43a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:43.985842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:43.991303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:43.991303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:43.991303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] PATH_INFO: `/v3/projects/2ff90e568189446691fa9f931b67aa6f/users/af5604234af64a319c513c4bc47ee923/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.021604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff90e568189446691fa9f931b67aa6f, user_id=af5604234af64a319c513c4bc47ee923, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.026534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.065171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:44.066882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:44.112989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 998/2021] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:43 2022] PUT /identity/v3/projects/2ff90e568189446691fa9f931b67aa6f/users/af5604234af64a319c513c4bc47ee923/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:44.114266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:44.116132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:44.130615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5d79-65a4-46f2-8b70-e9d78b209d68 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:44.194485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:44.195805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:44.196183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:44.196524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.197847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235040-531c-45ec-9501-06176d8dfbc3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:44.198851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:44.203992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:44.204713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:44.205069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:44.205413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] PATH_INFO: `/v3/projects/3e356a68fb104acea1acf4670eba897d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.206638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e356a68fb104acea1acf4670eba897d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.209616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.280547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.282577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.294221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:44.296457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1024/2022] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:44.298570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:44.309416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4a79-b426-41fc-ae13-b519c50ac235 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:44.314788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:44.315406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:44.315781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:44.316065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.316728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.318462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.333578 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1025/2023] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:44.335625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:44.343191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e356a68fb104acea1acf4670eba897d', 'request_id': 'req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.350373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e356a68fb104acea1acf4670eba897d', 'request_id': 'req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.355983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c6aa-6148-49aa-bfc8-5e871a87aad6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:44.416756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:44.417420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:44.417702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:44.417979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] PATH_INFO: `/v3/projects/2ff90e568189446691fa9f931b67aa6f/users/af5604234af64a319c513c4bc47ee923/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.419957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff90e568189446691fa9f931b67aa6f, user_id=af5604234af64a319c513c4bc47ee923, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.423271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.433751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1026/2024] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:44 2022] PUT /identity/v3/projects/2ff90e568189446691fa9f931b67aa6f/users/af5604234af64a319c513c4bc47ee923/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:44.434061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e356a68fb104acea1acf4670eba897d', 'request_id': 'req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.450699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] The token cache is being invalidate because project 3e356a68fb104acea1acf4670eba897d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:44.450699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.450699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.450699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 999/2025] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:44 2022] DELETE /identity/v3/projects/3e356a68fb104acea1acf4670eba897d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:44.453152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:44.454920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:44.523671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72f32-566d-45dd-99f2-0f51c755a66a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:44.529418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:44.530046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:44.530352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:44.530624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] PATH_INFO: `/v3/users/c2e97953ab864d6997b56a2a5c46bbf1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:44.531774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e97953ab864d6997b56a2a5c46bbf1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:44.534060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:44.887790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e97953ab864d6997b56a2a5c46bbf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.895562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e97953ab864d6997b56a2a5c46bbf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.896780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e97953ab864d6997b56a2a5c46bbf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.911894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e97953ab864d6997b56a2a5c46bbf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.912806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-79aa0e34-0bc3-4f98-b928-97a672aa5a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e97953ab864d6997b56a2a5c46bbf1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:44.972344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1027/2026] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:44 2022] DELETE /identity/v3/users/c2e97953ab864d6997b56a2a5c46bbf1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:45.470497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:45.486453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2c62-870f-48f9-a898-fa4d0c9c9bee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:45.578067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:45.578911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:45.587887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:45.587887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] PATH_INFO: `/v3/projects/4831d449f7c74ec39fcaf109b5ea0035` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:45.587887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4831d449f7c74ec39fcaf109b5ea0035)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:45.587887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:45.715394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4831d449f7c74ec39fcaf109b5ea0035', 'request_id': 'req-e1d97e2f-ddc5-47e5-96b7-07bc24759977'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:45.725217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4831d449f7c74ec39fcaf109b5ea0035', 'request_id': 'req-e1d97e2f-ddc5-47e5-96b7-07bc24759977'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:45.800164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4831d449f7c74ec39fcaf109b5ea0035', 'request_id': 'req-e1d97e2f-ddc5-47e5-96b7-07bc24759977'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:45.815817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] The token cache is being invalidate because project 4831d449f7c74ec39fcaf109b5ea0035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:45.816125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:45.816878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e1d97e2f-ddc5-47e5-96b7-07bc24759977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:45.818645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1000/2027] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:45 2022] DELETE /identity/v3/projects/4831d449f7c74ec39fcaf109b5ea0035 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:45.823902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4cec1-51a2-4b24-a06d-6358adc14c48 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:45.824415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4cec1-51a2-4b24-a06d-6358adc14c48 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:45.824510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4cec1-51a2-4b24-a06d-6358adc14c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:45.845092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f4f4cec1-51a2-4b24-a06d-6358adc14c48 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:45.846298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f4f4cec1-51a2-4b24-a06d-6358adc14c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:45.924654 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:45.925006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:45.925447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:45.927879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1028/2028] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:45.932989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebf72-7199-457d-9828-da0efd4e5132 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:45.932989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebf72-7199-457d-9828-da0efd4e5132 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:45.933253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebf72-7199-457d-9828-da0efd4e5132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:45.957281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:45.957931 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:45.967352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1001/2029] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:45.971839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:45.981058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f77ebf72-7199-457d-9828-da0efd4e5132 None None] MFA Rules not processed for user `af5604234af64a319c513c4bc47ee923`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:45.981900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d6a97-309e-45ee-a60f-3696a1207063 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:45.982699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f77ebf72-7199-457d-9828-da0efd4e5132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:45.988939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:45.989651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:45.990052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:45.990431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:45.991190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:45.991668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:45.996612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.009970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1002/2030] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:46.011019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.023594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143eac-cb96-4d29-8cb8-d0b17d82baad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.037768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.038525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.038906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.039324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.040083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.050067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.092773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1029/2031] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:46.099353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.099778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.100264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.126028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] MFA Rules not processed for user `60e561f003ef43d1909ffdd415257fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:46.127423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.161180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1003/2032] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:46.164514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.204182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1030/2033] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:46.215454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.228535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.244954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc66a09-62b2-4506-9444-53cb079abeb4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.250926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.251580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.251854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.253197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.253197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.255304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.303273 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d74cb-e183-462f-8696-62dd3499158b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.366853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.367467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.367775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.368046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.370031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.430410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.432175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.432321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1004/2034] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:46.433137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.434898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.439034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:46.444259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1031/2035] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:46.445065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.455928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c1fe0-e6dd-4e58-b178-ef042c75e7ee service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.461007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.461623 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.461897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.462336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.463651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.465601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.476208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1032/2036] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:46.480510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.491418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6501-af4e-41c5-a943-0a88efc56413 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.497165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.497800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.498150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.498659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.498964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.500615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.512851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1033/2037] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:46.516836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.520877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad95bd-986f-4c4b-b54c-8f04f14fd335 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.526167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.526798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.527226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.527522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.528770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70b6fa-6502-4a43-9bd6-6aa57f588155 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.529449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.533836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.534522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.534892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.535115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] PATH_INFO: `/v3/projects/d4d9bcc868a14029bf46148676698549/users/2e60486ff68d40f482707c9683cc5bf7/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.552720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d9bcc868a14029bf46148676698549, user_id=2e60486ff68d40f482707c9683cc5bf7, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.555419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.594486 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.595966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3c05a-0dd0-4d22-841a-785e3e036b75 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.605888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1005/2038] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:46.668332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1034/2039] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:46 2022] PUT /identity/v3/projects/d4d9bcc868a14029bf46148676698549/users/2e60486ff68d40f482707c9683cc5bf7/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:46.678572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.678938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.679305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.709388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:46.712298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] MFA Rules not processed for user `2e60486ff68d40f482707c9683cc5bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:46.713564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:46.784577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1006/2040] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:46.789140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:46.853445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee170f0-d9d5-4568-9471-ee7afebcb9e1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:46.858390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:46.859124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:46.859410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:46.859728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:46.860366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:46.867596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:46.988635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1035/2041] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:46.992841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.004707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188e11-ba53-4fdd-957d-5970cf834632 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.065278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.065896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.066177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.066447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.067136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.069153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.174609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1007/2042] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:46 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:47.176523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.193841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf808-9d22-4f61-9975-0ce44f541e83 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.201055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.201905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.202246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.202583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.203302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.205119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.224942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1036/2043] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:47.228765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.247911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dce14-b69a-4218-8bae-9cf6114def2f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.255061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.260515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.260888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.261230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.262655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.265169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295076c-924f-41b6-927b-504b01e0f859 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.278504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1008/2044] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:47.282326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.296853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66300-493c-4b7b-b20f-c65057c80b94 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.306824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.309265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.309265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.309265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] PATH_INFO: `/v3/projects/3c610e1029604e3bbbf39bfa0e27a317/users/3c734fc1414342b4b92cd636c8951a96/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.332268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c610e1029604e3bbbf39bfa0e27a317, user_id=3c734fc1414342b4b92cd636c8951a96, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.338851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.423034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1037/2045] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:47 2022] PUT /identity/v3/projects/3c610e1029604e3bbbf39bfa0e27a317/users/3c734fc1414342b4b92cd636c8951a96/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:47.433733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.434026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.434337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.463274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] MFA Rules not processed for user `3c734fc1414342b4b92cd636c8951a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:47.464578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:47.534786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1009/2046] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:47.539116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.552606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.554292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:47.624902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33897-9485-48c7-a8dd-5b11c65338e9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.631412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.632152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.632445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.636045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.636045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.636045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.650674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2de95-ac6a-4e91-89a1-f541088ae227 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.656258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.658942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.658942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.658942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] PATH_INFO: `/v3/users/4a45a5249ed24e5a9bb52d2b519cedd2` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.659189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a45a5249ed24e5a9bb52d2b519cedd2)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.661000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.730932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1038/2047] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:47 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:47.731981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.798123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701446e-b505-4357-a67a-6ea3c614ba49 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.802991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.803626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.803910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.804211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.804845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.807111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.900657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a45a5249ed24e5a9bb52d2b519cedd2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:47.901421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a45a5249ed24e5a9bb52d2b519cedd2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:47.910696 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a45a5249ed24e5a9bb52d2b519cedd2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:47.919319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1039/2048] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:47 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:47.921259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.926304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a45a5249ed24e5a9bb52d2b519cedd2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:47.932732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4ffd-7892-453c-8c5e-1ef8ae3c2a95 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.937641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.938242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.938524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.938795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.939462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.941181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:47.953285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1040/2049] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:47.963195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:47.973295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59567456-866b-4d4e-868b-7f5cb7d5cd07 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:47.978712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:47.979386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:47.979687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:47.979969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] PATH_INFO: `/v3/projects/5677f79d981f495eb3db325a4cc50e96/users/fed00ae8f2b7490f961a8c8f8bd84580/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:47.995854 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5677f79d981f495eb3db325a4cc50e96, user_id=fed00ae8f2b7490f961a8c8f8bd84580, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:47.998700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:48.037371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-0e37acad-83ee-498a-90fb-ef156b2307d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a45a5249ed24e5a9bb52d2b519cedd2'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:48.045190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1010/2050] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:47 2022] DELETE /identity/v3/users/4a45a5249ed24e5a9bb52d2b519cedd2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:48.049083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.049545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.049842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.069847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:48.071075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.097643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1041/2051] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:47 2022] PUT /identity/v3/projects/5677f79d981f495eb3db325a4cc50e96/users/fed00ae8f2b7490f961a8c8f8bd84580/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:48.100516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:48.103719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.200008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1011/2052] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:48.206121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:48.207720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.213555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbbcbc-1c99-4822-8ddf-2338b5c36755 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:48.221552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:48.223471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.223667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.223978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.224671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:48.226313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:48.239464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1042/2053] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:48.243698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:48.260563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b587caa-8cfc-487b-ab7a-170c03299091 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:48.265925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:48.266710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.267088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.267438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] PATH_INFO: `/v3/projects/5677f79d981f495eb3db325a4cc50e96/users/fed00ae8f2b7490f961a8c8f8bd84580/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.269900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5677f79d981f495eb3db325a4cc50e96, user_id=fed00ae8f2b7490f961a8c8f8bd84580, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:48.272806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99734-66bd-45e3-bfff-c0e37bf5ceac admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:48.295678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1043/2054] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:48 2022] PUT /identity/v3/projects/5677f79d981f495eb3db325a4cc50e96/users/fed00ae8f2b7490f961a8c8f8bd84580/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:48.301524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.301959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.302347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.302574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d455c-a9e3-4a05-8e59-8948caba9661 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:48.308436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:48.350398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] MFA Rules not processed for user `fed00ae8f2b7490f961a8c8f8bd84580`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:48.351781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.387005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:48.387961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.388393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.388948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.469330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:48.470693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:48.480086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1044/2055] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:48.483512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1012/2056] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:48.491212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:48.492958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.573243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2804ac-8f20-4546-8a43-d758eeceff97 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:48.577527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:48.578410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:48.578705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:48.578980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:48.580816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:48.626087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:48.673329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:48.674822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:48.684282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1045/2057] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:49.007221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:49.008717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:49.027290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cef5c-056a-4141-a183-bf6c11870376 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:49.032018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:49.033219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:49.033592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:49.033938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] PATH_INFO: `/v3/projects/a6e30dddc46549f299c4c533f182527c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:49.035163 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e30dddc46549f299c4c533f182527c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:49.037358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:49.222671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e30dddc46549f299c4c533f182527c', 'request_id': 'req-5830561c-ee15-4644-ae7e-2ffc0b115165'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.233001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e30dddc46549f299c4c533f182527c', 'request_id': 'req-5830561c-ee15-4644-ae7e-2ffc0b115165'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.331076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e30dddc46549f299c4c533f182527c', 'request_id': 'req-5830561c-ee15-4644-ae7e-2ffc0b115165'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.344445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] The token cache is being invalidate because project a6e30dddc46549f299c4c533f182527c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:49.344774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.345887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.347763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1013/2058] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:49 2022] DELETE /identity/v3/projects/a6e30dddc46549f299c4c533f182527c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:49.351820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:49.375034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f463b-dd8e-4aee-a948-08325e98c7a2 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:49.494238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:49.495234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:49.495755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:49.496317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] PATH_INFO: `/v3/users/b2fc493b28c343eca47abd7ada40ad5e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:49.497932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fc493b28c343eca47abd7ada40ad5e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:49.500018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:49.764070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fc493b28c343eca47abd7ada40ad5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.776799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fc493b28c343eca47abd7ada40ad5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.779018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fc493b28c343eca47abd7ada40ad5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.793490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fc493b28c343eca47abd7ada40ad5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.794139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fc493b28c343eca47abd7ada40ad5e'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:49.929054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1046/2059] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:49 2022] DELETE /identity/v3/users/b2fc493b28c343eca47abd7ada40ad5e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:50.043677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:50.446215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:50.846994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:50.852250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:50.882611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830561c-ee15-4644-ae7e-2ffc0b115165 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:50.886138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:50.887704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:51.008254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3953ec-a3ff-4a61-b72c-45754c66a7f8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:51.044629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:51.045418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.047642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.048045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.053521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:51.055924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:51.056646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.056952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.057247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] PATH_INFO: `/v3/projects/4d061e2cd2f041658aac43dcb9439530` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.066164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d061e2cd2f041658aac43dcb9439530)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:51.070386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:51.104933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:51.220240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:51.222154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad49fe-3d7e-427e-9f06-e9d0b7e43570 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:51.248285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1047/2060] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:51.300920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d061e2cd2f041658aac43dcb9439530', 'request_id': 'req-f9786fff-4f38-453c-827c-1ff08518ee90'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:51.309202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d061e2cd2f041658aac43dcb9439530', 'request_id': 'req-f9786fff-4f38-453c-827c-1ff08518ee90'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:51.378487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d061e2cd2f041658aac43dcb9439530', 'request_id': 'req-f9786fff-4f38-453c-827c-1ff08518ee90'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:51.398342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] The token cache is being invalidate because project 4d061e2cd2f041658aac43dcb9439530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:51.398956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:51.415845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f9786fff-4f38-453c-827c-1ff08518ee90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:51.419111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1014/2061] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:50 2022] DELETE /identity/v3/projects/4d061e2cd2f041658aac43dcb9439530 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:51.424628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.424947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.425233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.450850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:51.452695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:51.588991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1048/2062] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:51.593045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.593045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.593045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.614448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:51.615815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:51.625975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1015/2063] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:51.635396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:51.655640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dec5b3-438d-4389-965d-39596e07d316 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:51.664105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:51.666910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.669536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.669536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.670007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:51.670326 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:51.672000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:51.691416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1049/2064] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:51.692262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:51.710173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31bb7a-88c5-42fd-8fec-f2f95095bb5f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:51.717309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:51.718114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.718417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.718773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.719958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:51.721928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:51.878244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:51.895756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1016/2065] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:51 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:51.901789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:51.916569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb602-7a50-41ad-881d-74d205dd4341 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:51.987646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:51.988279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:51.988571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:51.988852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:51.989646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:51.991477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.083651 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1050/2066] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:51 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:52.083819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.094837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15739-0c8a-456e-a12b-a198e21b1268 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.098743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.099350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.099668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.099943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.100640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.102233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.113106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1017/2067] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:52.117710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.128572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d32471-ead7-404d-a32e-14c76eede24b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.133098 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.133690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.134130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.134411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.135195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.136830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb452c-54ff-4f30-af7e-b6c5b76c8c2c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.147374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1051/2068] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:52.151943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.163183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2099646-e257-46ac-b072-14e3e233fa53 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.168437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.169135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.169421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.169702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] PATH_INFO: `/v3/projects/0c862b918a6144ebbc5530e4897dfd5d/users/5ed368b8d8a04dd6a0bcb1ad445343cd/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.185458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c862b918a6144ebbc5530e4897dfd5d, user_id=5ed368b8d8a04dd6a0bcb1ad445343cd, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.188177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.211574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:52.281029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1018/2069] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:52 2022] PUT /identity/v3/projects/0c862b918a6144ebbc5530e4897dfd5d/users/5ed368b8d8a04dd6a0bcb1ad445343cd/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:52.293105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.293398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.293676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.326645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] MFA Rules not processed for user `5ed368b8d8a04dd6a0bcb1ad445343cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:52.327968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:52.411082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1052/2070] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:52.415746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.499927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5d5c-87c7-4df9-8bc1-ce6b3b47e068 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.505246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.505884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.506171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.506442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.507104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.509964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.640599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1019/2071] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:52 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:52.644465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.655847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93eff7-bdbb-4efa-870e-df80bc094913 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.695021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:52.726491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.727126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.727414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.727877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.728550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.734491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.815007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1053/2072] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:52 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:52.820030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.833820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90520d-63c2-41de-a41e-ac0349c460c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.839777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.840392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.840671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.840945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.841727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.843387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.855559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1020/2073] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:52.859842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.871447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525737-59f8-49ee-8c04-0d2ad867989a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.876089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.876744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.877021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.877295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] PATH_INFO: `/v3/projects/3addb1f1da204157962216d5d8130e77/users/5414ebeeaf944408962b2f8295d254f8/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.897966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:52.898668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3addb1f1da204157962216d5d8130e77, user_id=5414ebeeaf944408962b2f8295d254f8, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.900686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:52.901869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:52.914294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d58a1c-080c-44eb-9ef9-0fe41b377831 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:52.920032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:52.920736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:52.920936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:52.921322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] PATH_INFO: `/v3/users/67b50fb4e6664178a665d2e986859099` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:52.925332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b50fb4e6664178a665d2e986859099)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:52.928318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.018614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1054/2074] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:52 2022] PUT /identity/v3/projects/3addb1f1da204157962216d5d8130e77/users/5414ebeeaf944408962b2f8295d254f8/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:53.022034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.080953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:53.108323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca743bf-5e09-4cb3-955c-14622ed6019d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.117247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.118114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.118604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.119022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.119871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.123556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.135188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1055/2075] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:53.138486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.141131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.168729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b50fb4e6664178a665d2e986859099'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.169940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b50fb4e6664178a665d2e986859099'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.177865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a07a6-6f1a-4a53-b766-548e339b6d9f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.179704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b50fb4e6664178a665d2e986859099'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.185315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.190220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.190220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.190220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] PATH_INFO: `/v3/users/44506bca7e0a44849dcd71bdcdbdd747` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.190220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44506bca7e0a44849dcd71bdcdbdd747)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.192387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.197785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b50fb4e6664178a665d2e986859099'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.256411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b50fb4e6664178a665d2e986859099'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.264855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1021/2076] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:52 2022] DELETE /identity/v3/users/67b50fb4e6664178a665d2e986859099 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:53.265885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.278441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.395648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e881-a0c7-49b7-b1bd-be1284dd9780 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.406774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.407389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.408240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.408524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] PATH_INFO: `/v3/projects/3addb1f1da204157962216d5d8130e77/users/5414ebeeaf944408962b2f8295d254f8/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.412586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3addb1f1da204157962216d5d8130e77, user_id=5414ebeeaf944408962b2f8295d254f8, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.416874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.421954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44506bca7e0a44849dcd71bdcdbdd747'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.430195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44506bca7e0a44849dcd71bdcdbdd747'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.430972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44506bca7e0a44849dcd71bdcdbdd747'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.437357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1022/2077] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:53 2022] PUT /identity/v3/projects/3addb1f1da204157962216d5d8130e77/users/5414ebeeaf944408962b2f8295d254f8/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:53.438652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.440686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.447557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44506bca7e0a44849dcd71bdcdbdd747'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.448779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ba339020-8526-4693-bf01-d4f5fc17cd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44506bca7e0a44849dcd71bdcdbdd747'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.508278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf6be-db53-427b-9b3a-320de9809869 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.512373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.513088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.513901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.513901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.515964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.539541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1056/2078] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:53 2022] DELETE /identity/v3/users/44506bca7e0a44849dcd71bdcdbdd747 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:53.539541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.539833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.540833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.569276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] MFA Rules not processed for user `5414ebeeaf944408962b2f8295d254f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:53.570494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.586602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.588736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf2fb-a4ad-47ef-b045-3c17d725f5f4 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.600009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1023/2079] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:53.607050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.607631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.608118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.654668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:53.656009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.666971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1057/2080] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:53.672314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.673728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.733611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1024/2081] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:53.734463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.735937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.745788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4783a8-b023-4a5e-96b7-cd828b3423fa None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.751379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.752362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.752698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.752982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] PATH_INFO: `/v3/projects/d1cbb94191ee46e09a53e7b3f1130afe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.754179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cbb94191ee46e09a53e7b3f1130afe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.756721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.783291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:53.799520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc813b3c-af4c-4510-a576-d0abe4f6b364 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.803438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.804122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.804432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.804716 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.823186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:53.823186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:53.843452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1025/2082] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:53.845959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:53.850236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:53.882509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cbb94191ee46e09a53e7b3f1130afe', 'request_id': 'req-4e7af120-1ada-43a6-84fb-334ce1c7429f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.889188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cbb94191ee46e09a53e7b3f1130afe', 'request_id': 'req-4e7af120-1ada-43a6-84fb-334ce1c7429f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.928899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8acbb-b130-40c3-bfa8-cdb01fd1e70c service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:53.963901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cbb94191ee46e09a53e7b3f1130afe', 'request_id': 'req-4e7af120-1ada-43a6-84fb-334ce1c7429f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.984673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] The token cache is being invalidate because project d1cbb94191ee46e09a53e7b3f1130afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:53.984971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.985838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4e7af120-1ada-43a6-84fb-334ce1c7429f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:53.987274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:53.987837 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1058/2083] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:53 2022] DELETE /identity/v3/projects/d1cbb94191ee46e09a53e7b3f1130afe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:53.987954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.992564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.992810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:53.992999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.993636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:53.993890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:53.996246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.017581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:54.019031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.066366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:54.080348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.082719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a85bb-5240-4b34-9017-65e2c4a92b80 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.096071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1026/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:54.104834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1059/2085] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:54.114784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.115080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.115361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.140577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:54.141920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.151032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1027/2086] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:54.155649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.173786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5b433-ae11-48a5-afe3-3a1e1caddcb4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.178638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.179620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.179734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.179926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.181609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:54.181609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.182735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.205150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1060/2087] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:37:54.206478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.221872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89819b1-74ad-41c1-9377-349251c5e227 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.226914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.228296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.228581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.228861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.229495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.231419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.362695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1028/2088] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:54 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:37:54.367179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.380749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada316f9-0712-471e-a8e6-399d09962be8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.456137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.456787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.457219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.461801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.461801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.461801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.532915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1061/2089] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:54 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:54.536663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.547292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318756f3-2114-4ed2-b9d0-ec634578d92a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.552093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.552731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.553016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.553296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.553952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.555617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.565919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1029/2090] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:54.570631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.582034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc13d-8d29-4b61-9cd7-9a7cb328a6f7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.586981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.588127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.592206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.592206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.592206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.592206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.605792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1062/2091] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:54.607405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.617465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada67ce-9fb2-44a6-bb5c-11630b97a371 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.622229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.622890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.623178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.623786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] PATH_INFO: `/v3/projects/cec80e12d95b4ea4939c57abc8393d93/users/01e09dde19114205bc3a73aab9e8cbbd/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.640019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec80e12d95b4ea4939c57abc8393d93, user_id=01e09dde19114205bc3a73aab9e8cbbd, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.642705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075f44c-0354-464f-917e-4a46173ddac9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.664353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.666586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.679707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7d470-99c0-4f38-9728-1580c86a08c9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.685337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.685979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.686262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.686537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] PATH_INFO: `/v3/projects/142a440a15d44fbfa4150bf044f346bf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.688008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142a440a15d44fbfa4150bf044f346bf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.689927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.771009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1030/2092] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:54 2022] PUT /identity/v3/projects/cec80e12d95b4ea4939c57abc8393d93/users/01e09dde19114205bc3a73aab9e8cbbd/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:54.776318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.776470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.776721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.796598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:54.797828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.811699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142a440a15d44fbfa4150bf044f346bf', 'request_id': 'req-56c30995-5060-41bd-9161-854fcec49098'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:54.817141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142a440a15d44fbfa4150bf044f346bf', 'request_id': 'req-56c30995-5060-41bd-9161-854fcec49098'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:54.857838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1031/2093] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:54.875407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.876830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.885110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142a440a15d44fbfa4150bf044f346bf', 'request_id': 'req-56c30995-5060-41bd-9161-854fcec49098'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:54.900923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] The token cache is being invalidate because project 142a440a15d44fbfa4150bf044f346bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:54.901359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:54.903398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:54.905143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1063/2094] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:54 2022] DELETE /identity/v3/projects/142a440a15d44fbfa4150bf044f346bf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:54.909120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.910465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.928008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30995-5060-41bd-9161-854fcec49098 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.933194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.933836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.934115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.934390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] PATH_INFO: `/v3/users/5bf795b1a1ed4467a3f9ea283c2c8e15` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.935796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf795b1a1ed4467a3f9ea283c2c8e15)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.938771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.948882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ada872-7f66-4310-9798-c2f63cf6ac2c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:54.958830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:54.958830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:54.958830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:54.958830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:54.959231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:54.973607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:54.975390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:54.987076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1032/2095] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:54.992438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:54.994352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:55.008245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a9844-544d-46d3-a5da-43949d7de7b7 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:55.013593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:55.014372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:55.014807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:55.015104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] PATH_INFO: `/v3/users/5ed368b8d8a04dd6a0bcb1ad445343cd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:55.016337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed368b8d8a04dd6a0bcb1ad445343cd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:55.018269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:55.157099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf795b1a1ed4467a3f9ea283c2c8e15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.164833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf795b1a1ed4467a3f9ea283c2c8e15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.165952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf795b1a1ed4467a3f9ea283c2c8e15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.179229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf795b1a1ed4467a3f9ea283c2c8e15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.179972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-23374128-5761-41c9-82bc-3c93e374f049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf795b1a1ed4467a3f9ea283c2c8e15'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.285555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1064/2096] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:54 2022] DELETE /identity/v3/users/5bf795b1a1ed4467a3f9ea283c2c8e15 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:55.296232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed368b8d8a04dd6a0bcb1ad445343cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.297211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed368b8d8a04dd6a0bcb1ad445343cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.305742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed368b8d8a04dd6a0bcb1ad445343cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.320237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed368b8d8a04dd6a0bcb1ad445343cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.408677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed368b8d8a04dd6a0bcb1ad445343cd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:55.415245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1033/2097] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:54 2022] DELETE /identity/v3/users/5ed368b8d8a04dd6a0bcb1ad445343cd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:55.420139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:55.420436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:55.420718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:55.439993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:55.441202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:55.501156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1065/2098] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:55.511713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:55.513167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:55.606698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1346d-2ecb-40b8-b5e2-b9bf3e5102ee admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:55.610579 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:55.611194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:55.611476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:55.611789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:55.624632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:55.625852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:55.637295 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1034/2099] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:37:55.746400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:56.542831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:56.585187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:56.587023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:56.603134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c547d-fd33-4150-8f39-186eee22eefb None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:56.608552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:56.609411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:56.609948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:56.610839 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] PATH_INFO: `/v3/projects/65819b9fa51c4529b2829315dc92a773` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:56.612984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=65819b9fa51c4529b2829315dc92a773)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:56.615236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:56.777021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65819b9fa51c4529b2829315dc92a773', 'request_id': 'req-a33d091e-3ac7-4619-bf14-65c60b90f4bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:56.791331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65819b9fa51c4529b2829315dc92a773', 'request_id': 'req-a33d091e-3ac7-4619-bf14-65c60b90f4bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:56.844750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65819b9fa51c4529b2829315dc92a773', 'request_id': 'req-a33d091e-3ac7-4619-bf14-65c60b90f4bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:56.857969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] The token cache is being invalidate because project 65819b9fa51c4529b2829315dc92a773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:56.858268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:56.858946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:56.860479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1066/2100] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:56 2022] DELETE /identity/v3/projects/65819b9fa51c4529b2829315dc92a773 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:56.864694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:56.881659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce341-c107-4db0-99b4-38a5b0cc7467 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:56.885766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:56.887757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:56.941452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:56.942140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:56.942500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:56.942852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] PATH_INFO: `/v3/users/7c6aae5aef464497b30bf13fff97601a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:56.944158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6aae5aef464497b30bf13fff97601a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:56.946206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:56.985144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d091e-3ac7-4619-bf14-65c60b90f4bf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:56.991941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:56.994449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:56.994449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:56.994449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] PATH_INFO: `/v3/projects/0c862b918a6144ebbc5530e4897dfd5d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:56.996072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c862b918a6144ebbc5530e4897dfd5d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:56.998039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:57.194453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c862b918a6144ebbc5530e4897dfd5d', 'request_id': 'req-879df965-cbe6-4963-8b22-bd82607f4fe4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.196276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6aae5aef464497b30bf13fff97601a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.197171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6aae5aef464497b30bf13fff97601a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.200513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c862b918a6144ebbc5530e4897dfd5d', 'request_id': 'req-879df965-cbe6-4963-8b22-bd82607f4fe4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.204373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6aae5aef464497b30bf13fff97601a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.217430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6aae5aef464497b30bf13fff97601a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.325119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c862b918a6144ebbc5530e4897dfd5d', 'request_id': 'req-879df965-cbe6-4963-8b22-bd82607f4fe4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.338574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] The token cache is being invalidate because project 0c862b918a6144ebbc5530e4897dfd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:57.338878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.339758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.342025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1067/2101] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:56 2022] DELETE /identity/v3/projects/0c862b918a6144ebbc5530e4897dfd5d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:57.360556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:57.362485 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:57.421806 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6aae5aef464497b30bf13fff97601a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.429140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1035/2102] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:56 2022] DELETE /identity/v3/users/7c6aae5aef464497b30bf13fff97601a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:57.432556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df965-cbe6-4963-8b22-bd82607f4fe4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:57.491555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:57.492196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:57.493069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:57.493389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] PATH_INFO: `/v3/users/5414ebeeaf944408962b2f8295d254f8` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:57.494902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5414ebeeaf944408962b2f8295d254f8)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:57.496890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:57.742280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5414ebeeaf944408962b2f8295d254f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.753037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5414ebeeaf944408962b2f8295d254f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.754072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5414ebeeaf944408962b2f8295d254f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.773286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5414ebeeaf944408962b2f8295d254f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.774047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68f69bf4-05f3-4629-9dce-c861e6a61dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5414ebeeaf944408962b2f8295d254f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:57.850807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1068/2103] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:57 2022] DELETE /identity/v3/users/5414ebeeaf944408962b2f8295d254f8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:37:58.195756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:58.195756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:58.253613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49c94-be12-4617-b82a-138ae20960d1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:58.315428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:58.316103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.316388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.316718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] PATH_INFO: `/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.318000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=04572f1c8d284fb29f2b1279dbd7fa9f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:58.319958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:58.354529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:58.440173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04572f1c8d284fb29f2b1279dbd7fa9f', 'request_id': 'req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:58.445457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04572f1c8d284fb29f2b1279dbd7fa9f', 'request_id': 'req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:58.564674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04572f1c8d284fb29f2b1279dbd7fa9f', 'request_id': 'req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:58.592026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] The token cache is being invalidate because project 04572f1c8d284fb29f2b1279dbd7fa9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:58.592331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:58.593428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea42d37c-66ac-47af-b4c9-e62a76fdf6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:58.595540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1036/2104] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:58 2022] DELETE /identity/v3/projects/04572f1c8d284fb29f2b1279dbd7fa9f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:58.600720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.601174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.601549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.626548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:58.628021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:58.719250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:58.737210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1069/2105] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:58.744996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.745288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.745569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.766564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:58.767894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:58.777413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1037/2106] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:58.782523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:58.792590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:58.794110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:58.799742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87913660-44f8-42ab-9cfc-dcaf14a7c167 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:58.810933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c0164-919f-4fde-86dd-9061d16ab341 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:58.817209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:58.817872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.818217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.818502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] PATH_INFO: `/v3/projects/3addb1f1da204157962216d5d8130e77` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.819804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3addb1f1da204157962216d5d8130e77)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:58.823419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:58.824618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:58.825531 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.826027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.826380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.827124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:58.827524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:58.829582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:58.844269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1070/2107] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:58.850551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:58.863218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f729c-8592-4075-853d-accbda471fb4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:58.874790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:58.878505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:58.878505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:58.878505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:58.878505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:58.879031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.020604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1071/2108] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:58 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:59.025691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.031423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3addb1f1da204157962216d5d8130e77', 'request_id': 'req-c5569a4b-7bad-460c-9200-cb414a1fb19f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:59.043441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3addb1f1da204157962216d5d8130e77', 'request_id': 'req-c5569a4b-7bad-460c-9200-cb414a1fb19f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:59.110113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0191-8372-47ef-9ef3-bf54969b8d53 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.116989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.117627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.117941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.118282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.118870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.122582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.162852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3addb1f1da204157962216d5d8130e77', 'request_id': 'req-c5569a4b-7bad-460c-9200-cb414a1fb19f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:59.173740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] The token cache is being invalidate because project 3addb1f1da204157962216d5d8130e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:37:59.174059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:59.174964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c5569a4b-7bad-460c-9200-cb414a1fb19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:37:59.176894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1038/2109] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:37:58 2022] DELETE /identity/v3/projects/3addb1f1da204157962216d5d8130e77 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:59.182220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338b96-eae8-4eb5-a370-36c13ebb92e4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.182587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338b96-eae8-4eb5-a370-36c13ebb92e4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.182937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338b96-eae8-4eb5-a370-36c13ebb92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.219252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-72338b96-eae8-4eb5-a370-36c13ebb92e4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:59.221425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-72338b96-eae8-4eb5-a370-36c13ebb92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.232889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1072/2110] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:59.234855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.239332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1039/2111] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:59.240166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.253472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.253830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.254447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.265069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9aeb2-6b8a-449b-9533-fe9692788d3f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.276702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.277332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.277619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.278437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.278557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.280264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.280598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:59.282838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.301354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1040/2112] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:37:59.302088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1073/2113] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:59.303896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.307266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.315433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface9ae-040e-4e4a-9231-a362c5701935 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.321943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.322782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.323300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.323673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.324524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.326642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.330575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a07c-38e8-4d4c-80ff-0ad2b3acf1e4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.335681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.336380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.336835 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.337120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.337863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:37:59.338173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.340238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1041/2114] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:37:59.344073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.345537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.376209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbca46-6cc3-497c-a9ca-8b818ebb5af9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.382288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.383421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.387571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.387571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] PATH_INFO: `/v3/projects/cb8985d6e43f4ea29362eba1253c29c7/users/99334ff226424a3ab1457e88ff21fe1a/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.395814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1074/2115] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:37:59.396762 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.425996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95d65-b200-4260-aae5-a79af4ed95de admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.431044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.431665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8985d6e43f4ea29362eba1253c29c7, user_id=99334ff226424a3ab1457e88ff21fe1a, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.431796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.432024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.432321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.433057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.435025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.435660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e488-ee6d-4619-8aef-b56e36bb2a67 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.602345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1042/2116] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:59 2022] PUT /identity/v3/projects/cb8985d6e43f4ea29362eba1253c29c7/users/99334ff226424a3ab1457e88ff21fe1a/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:37:59.607465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.607813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.608104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.613040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1075/2117] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:59.621055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.642093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:37:59.643356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.714088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d93c9-3ba2-46ec-8f8b-8b4293de9dfe admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.723161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.726209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.726209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.726209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.726209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.729647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.735622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1043/2118] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:37:59.746546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.748166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.831155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6a581-84f8-4fbc-af1b-c5959f4ada19 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.836241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.838033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.838330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.838973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.853801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1076/2119] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:37:59 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:37:59.854315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.856134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:37:59.870204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.873105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.878723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7a89-9380-417e-910f-cd3e067acb25 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.893304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1044/2120] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:37:59.894541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.903002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.903806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.904163 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.904540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] PATH_INFO: `/v3/users/2e60486ff68d40f482707c9683cc5bf7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.905862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e60486ff68d40f482707c9683cc5bf7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.908335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.908506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9fa96-61ea-411b-989b-341f0469c19d service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.914437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.915616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.916019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.916293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.917300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.919035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.930835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1045/2121] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:59.935459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.947428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710dfaf-0442-4cd2-9f38-db0f89f9898d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.952303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.952909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.953196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.953625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:37:59.954265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:37:59.955902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:37:59.966484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1046/2122] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:37:59.970683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:37:59.982855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab0d-0e85-4258-b26f-bf520f7c308a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:37:59.988589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:37:59.989379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:37:59.989545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:37:59.989821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] PATH_INFO: `/v3/projects/4ab42ecab86c4c70bac894372316485d/users/f79b6e33d7e54241935fdb908ac9bda0/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.014508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab42ecab86c4c70bac894372316485d, user_id=f79b6e33d7e54241935fdb908ac9bda0, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.017348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07fd5-eb5f-4e34-a342-fcab7c1e5f33 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.113194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1047/2123] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:37:59 2022] PUT /identity/v3/projects/4ab42ecab86c4c70bac894372316485d/users/f79b6e33d7e54241935fdb908ac9bda0/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:00.124037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e60486ff68d40f482707c9683cc5bf7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:00.125418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.126146 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.126687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.139921 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e60486ff68d40f482707c9683cc5bf7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:00.142641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e60486ff68d40f482707c9683cc5bf7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:00.170215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] MFA Rules not processed for user `f79b6e33d7e54241935fdb908ac9bda0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:00.172715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:00.175170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e60486ff68d40f482707c9683cc5bf7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:00.177006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-cadd5ecd-df5e-4c79-9836-1f6da08c6026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e60486ff68d40f482707c9683cc5bf7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:00.257497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1077/2124] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:37:59 2022] DELETE /identity/v3/users/2e60486ff68d40f482707c9683cc5bf7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:00.263296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.263622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.264084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.266318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1048/2125] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:00.271552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.275293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:00.291807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:00.293213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:00.375663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1078/2126] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:00.386465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845fecb-ce38-4862-9a15-224b0e5f3061 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:00.397666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:00.400748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.402238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:00.404110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.405336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.405623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.407691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.412320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.490315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533865cb-d848-4156-8e8d-42a6b381ca81 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:00.500237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:00.500237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.500237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.500237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.512445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.514185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.531271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1079/2127] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:00.535315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1049/2128] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:00 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:38:00.541176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.555064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67f1e4-e0e0-40a7-acc6-be07b23c74d8 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:00.637038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:00.637739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.638028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.638304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.640226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.642758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.760802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1080/2129] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:00 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:00.764629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.777324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854051-0f02-4204-b226-674b7a01458b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:00.783199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:00.794968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.794968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.794968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.794968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.794968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.802115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1050/2130] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:00.805278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.817670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bf21-5f5c-4889-a21d-035909f1192a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:00.822920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:00.823640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:00.823929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:00.824210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] PATH_INFO: `/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6/users/3a316f8af4f946afa0f62802a8723736/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:00.841501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9519beb28cd4620a7b6ba0f4e5398b6, user_id=3a316f8af4f946afa0f62802a8723736, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:00.844551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:00.923507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1081/2131] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:00 2022] PUT /identity/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6/users/3a316f8af4f946afa0f62802a8723736/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:00.928450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:00.959623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc825acb-b3b4-45ab-a3f6-c4d9c1bb2c6f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:01.094469 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:01.112410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:01.113056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.113343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.115760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.116511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:01.119701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:01.142388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1051/2132] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:01.146335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:01.162231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49cef-efd3-4404-a58d-caa1a4209434 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:01.177422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:01.178722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.181681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.181681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] PATH_INFO: `/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6/users/3a316f8af4f946afa0f62802a8723736/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.184324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9519beb28cd4620a7b6ba0f4e5398b6, user_id=3a316f8af4f946afa0f62802a8723736, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:01.192951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80191fc2-2b88-46ce-8ec7-6f0b8a74628c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:01.193996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:01.205345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:01.218770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1082/2133] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:01 2022] PUT /identity/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6/users/3a316f8af4f946afa0f62802a8723736/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:01.230639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.230900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.231178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.235335 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1baa28-71dd-443d-858d-d3bf0c019aad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:01.262843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] MFA Rules not processed for user `3a316f8af4f946afa0f62802a8723736`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:01.264178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:01.349934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:01.351156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.351156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.351351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] PATH_INFO: `/v3/projects/d4d9bcc868a14029bf46148676698549` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.356793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d9bcc868a14029bf46148676698549)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:01.359272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:01.372397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1083/2134] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:01.378912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:01.386313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:01.388095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:01.496222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58e4d8-420c-4789-a4f0-68e18436c63d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:01.509124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d9bcc868a14029bf46148676698549', 'request_id': 'req-74ab30bd-d872-4885-b986-07d23a3429cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.532942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d9bcc868a14029bf46148676698549', 'request_id': 'req-74ab30bd-d872-4885-b986-07d23a3429cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.597190 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:01.597374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.597648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.597965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.605573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d9bcc868a14029bf46148676698549', 'request_id': 'req-74ab30bd-d872-4885-b986-07d23a3429cf'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.625211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] The token cache is being invalidate because project d4d9bcc868a14029bf46148676698549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:01.625511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.626228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.628565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1052/2135] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:01 2022] DELETE /identity/v3/projects/d4d9bcc868a14029bf46148676698549 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:01.631941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:01.633353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:01.706030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:01.707702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4fce9-5c02-4fa4-9fcd-e9c8d1de782f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:01.719079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1084/2136] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:38:01.735276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab30bd-d872-4885-b986-07d23a3429cf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:01.742020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:01.744284 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.744793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.745166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] PATH_INFO: `/v3/users/3c734fc1414342b4b92cd636c8951a96` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.746925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c734fc1414342b4b92cd636c8951a96)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:01.749345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:01.841602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:01.841901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:01.842206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:01.889393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] MFA Rules not processed for user `99334ff226424a3ab1457e88ff21fe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:01.890715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:01.974384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c734fc1414342b4b92cd636c8951a96'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.976132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c734fc1414342b4b92cd636c8951a96'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:01.984394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1085/2137] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:02.018079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:02.035747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c734fc1414342b4b92cd636c8951a96'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:02.040703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:02.059011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a768078-4271-45dc-adcd-b2386f586a77 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:02.064642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:02.065522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:02.072401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:02.072401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:02.074528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c734fc1414342b4b92cd636c8951a96'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:02.079279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:02.081109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:02.094376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1086/2138] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:02.095787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:02.109823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:02.141573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ecbd-42df-435a-9182-9def0e8bea26 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:02.156986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c734fc1414342b4b92cd636c8951a96'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:02.166428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1053/2139] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:01 2022] DELETE /identity/v3/users/3c734fc1414342b4b92cd636c8951a96 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:02.179222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:02.181006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:02.182497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:02.184012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:02.200858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:02.329225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:02.331694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1cd8b-4b4a-45e6-826e-762c6857b7c1 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:02.370099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1087/2140] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:02.405396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:02.766936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:02.768443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:02.881140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6d16d-10c6-4bd6-a488-4c8aebb295c5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:02.886879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:02.887726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:02.887907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:02.888186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] PATH_INFO: `/v3/projects/3c610e1029604e3bbbf39bfa0e27a317` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:02.889434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c610e1029604e3bbbf39bfa0e27a317)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:02.891541 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:03.076764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c610e1029604e3bbbf39bfa0e27a317', 'request_id': 'req-ea38291d-b336-43c4-a8a9-d17541f64ca6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.099940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c610e1029604e3bbbf39bfa0e27a317', 'request_id': 'req-ea38291d-b336-43c4-a8a9-d17541f64ca6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.106635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:03.108011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:03.108506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:03.172614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] MFA Rules not processed for user `01e09dde19114205bc3a73aab9e8cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:03.175748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:03.203909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c610e1029604e3bbbf39bfa0e27a317', 'request_id': 'req-ea38291d-b336-43c4-a8a9-d17541f64ca6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.227182 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] The token cache is being invalidate because project 3c610e1029604e3bbbf39bfa0e27a317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:03.229095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.231877 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.236605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1054/2141] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:02 2022] DELETE /identity/v3/projects/3c610e1029604e3bbbf39bfa0e27a317 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:03.240302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:03.242263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:03.289037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:03.358881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1088/2142] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:03.373737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:03.379693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:03.426082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38291d-b336-43c4-a8a9-d17541f64ca6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:03.437010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:03.441049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:03.441049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:03.441049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] PATH_INFO: `/v3/users/fed00ae8f2b7490f961a8c8f8bd84580` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:03.442027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed00ae8f2b7490f961a8c8f8bd84580)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:03.444297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:03.495880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f2a0e-354f-4d66-aff4-c467eb09b703 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:03.504087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:03.506111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:03.506397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:03.506674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:03.518279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:03.520114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:03.535693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1089/2143] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:03.692861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed00ae8f2b7490f961a8c8f8bd84580'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.693660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed00ae8f2b7490f961a8c8f8bd84580'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.701077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed00ae8f2b7490f961a8c8f8bd84580'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.713585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed00ae8f2b7490f961a8c8f8bd84580'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.797228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6579679d-ec35-4d8b-b5da-c62ff699a61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed00ae8f2b7490f961a8c8f8bd84580'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:03.808231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1055/2144] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:03 2022] DELETE /identity/v3/users/fed00ae8f2b7490f961a8c8f8bd84580 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:04.341062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:04.359019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a79f-88a4-4c2e-9304-dc575047b093 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:04.445027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd2e2-8c29-420c-a067-86c9883b7754 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:04.446349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd2e2-8c29-420c-a067-86c9883b7754 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:04.446958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd2e2-8c29-420c-a067-86c9883b7754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:04.470302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:04.471356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:04.471674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:04.472105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] PATH_INFO: `/v3/projects/5677f79d981f495eb3db325a4cc50e96` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:04.473849 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b45dd2e2-8c29-420c-a067-86c9883b7754 None None] MFA Rules not processed for user `99334ff226424a3ab1457e88ff21fe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:04.474353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5677f79d981f495eb3db325a4cc50e96)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:04.475467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b45dd2e2-8c29-420c-a067-86c9883b7754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:04.476776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:04.568457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1056/2145] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:04.693999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5677f79d981f495eb3db325a4cc50e96', 'request_id': 'req-7a63442f-4060-4deb-9c0b-fd0fc938af63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:04.706573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5677f79d981f495eb3db325a4cc50e96', 'request_id': 'req-7a63442f-4060-4deb-9c0b-fd0fc938af63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:04.816613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5677f79d981f495eb3db325a4cc50e96', 'request_id': 'req-7a63442f-4060-4deb-9c0b-fd0fc938af63'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:04.830944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] The token cache is being invalidate because project 5677f79d981f495eb3db325a4cc50e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:04.831308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:04.832069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-7a63442f-4060-4deb-9c0b-fd0fc938af63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:04.842020 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:04.842150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:04.842657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:04.846339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1090/2146] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:04 2022] DELETE /identity/v3/projects/5677f79d981f495eb3db325a4cc50e96 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:04.866574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:04.869123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:04.876039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:04.941185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1057/2147] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:04.949667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:04.949975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:04.950237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:04.984249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:04.988254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:05.033530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1091/2148] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:05.037253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.052055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78bf97-6d5c-47b4-aace-340ad2954b24 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.065768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.066419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.066708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.066991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.067747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:05.068066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.086131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.101974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1058/2149] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:05.106402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.115941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d883-1abe-4b4e-9775-0ac21e36ea00 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.122358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.123076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.123363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.123676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.124327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.126391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.243301 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1092/2150] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:05 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:05.247632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.259853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd41a-59bc-4d9f-a013-f0519093a66d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.323695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.324394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.325240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.325620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.326418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.339679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.472999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1059/2151] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:05 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:38:05.477927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.501891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87408a1-ead6-4a46-9845-b5c4f113f2da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.501891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.501891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.501891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.502241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.502241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.503314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.515415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1093/2152] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:05.519227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.535245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7f79-0f35-48a5-af9b-10596f320280 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.542446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.549403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.552986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.552986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.552986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.555044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22999d8f-fe45-49d9-aabb-de581703ec29 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.575927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1060/2153] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:05.579586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.593438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7725f-3220-4e3e-a645-4cbe6e8b361d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:05.601177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:05.602065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.602937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.603399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] PATH_INFO: `/v3/projects/9146f31d2f1e4b3e9fd32e42654e902e/users/dc296a7422714a068b3abb84b1749434/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.623162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9146f31d2f1e4b3e9fd32e42654e902e, user_id=dc296a7422714a068b3abb84b1749434, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:05.626901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:05.725092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1094/2154] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:05 2022] PUT /identity/v3/projects/9146f31d2f1e4b3e9fd32e42654e902e/users/dc296a7422714a068b3abb84b1749434/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:05.726070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:05.728626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:05.728982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:05.766084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:05.767356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:05.872208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1061/2155] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:05.887185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.889445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:05.911856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:05.915655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:06.006094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51100e-c8ed-4a25-85a8-74d95fce77a1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:06.016736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:06.019888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:06.020179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:06.020683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:06.025544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:06.058823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30525-e2f6-44cf-a770-1dbd042efd43 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:06.064702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:06.065951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:06.066501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:06.066993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:06.079727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:06.081332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:06.092202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1095/2156] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:38:06.129887 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:06.131384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa578-f8aa-4c2c-afb4-5a4a64d9094d service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:06.143441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1062/2157] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:06.244783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:06.389355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:06.391662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:06.426148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056b62-274e-420b-9c8e-2b88cf74e30e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:06.432647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:06.442153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:06.442442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:06.442904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] PATH_INFO: `/v3/users/f79b6e33d7e54241935fdb908ac9bda0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:06.444711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79b6e33d7e54241935fdb908ac9bda0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:06.447609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:06.752649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79b6e33d7e54241935fdb908ac9bda0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:06.760345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79b6e33d7e54241935fdb908ac9bda0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:06.761097 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79b6e33d7e54241935fdb908ac9bda0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:06.794271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79b6e33d7e54241935fdb908ac9bda0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:06.795331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79b6e33d7e54241935fdb908ac9bda0'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:06.885847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1096/2158] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:06 2022] DELETE /identity/v3/users/f79b6e33d7e54241935fdb908ac9bda0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:06.890540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dcab-afa2-4f41-a941-fdf352cf451a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:06.891048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dcab-afa2-4f41-a941-fdf352cf451a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:06.891273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dcab-afa2-4f41-a941-fdf352cf451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:06.920268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9627dcab-afa2-4f41-a941-fdf352cf451a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:06.921533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9627dcab-afa2-4f41-a941-fdf352cf451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:07.033527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:07.154880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1063/2159] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:07.175991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:07.178479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:07.266487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e89f-1752-4bf3-98c0-5b287e8f372e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:07.278607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:07.279248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:07.280684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:07.281110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:07.302634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:07.305178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:07.322234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1097/2160] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:07.431158 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:07.431447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:07.431755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:07.473191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] MFA Rules not processed for user `01e09dde19114205bc3a73aab9e8cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:07.476674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:07.613053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1064/2161] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:08.508231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:08.509861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:08.526426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7882ae6-509a-4991-b5fb-f83014f717f5 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:08.531905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:08.534769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:08.535210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:08.535656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] PATH_INFO: `/v3/projects/4ab42ecab86c4c70bac894372316485d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:08.537002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab42ecab86c4c70bac894372316485d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:08.539070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:08.757110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab42ecab86c4c70bac894372316485d', 'request_id': 'req-e0be7c68-9e6e-4a7c-be71-978131af878a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:08.766150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab42ecab86c4c70bac894372316485d', 'request_id': 'req-e0be7c68-9e6e-4a7c-be71-978131af878a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:08.843154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab42ecab86c4c70bac894372316485d', 'request_id': 'req-e0be7c68-9e6e-4a7c-be71-978131af878a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:08.856815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] The token cache is being invalidate because project 4ab42ecab86c4c70bac894372316485d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:08.857104 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:08.857774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:08.859289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1098/2162] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:08 2022] DELETE /identity/v3/projects/4ab42ecab86c4c70bac894372316485d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:08.863288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:08.875956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3cae3-2749-4edb-9997-4c71708e19e2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:08.936033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:08.936736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:08.937092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:08.937382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] PATH_INFO: `/v3/users/3a316f8af4f946afa0f62802a8723736` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:08.938530 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a316f8af4f946afa0f62802a8723736)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:08.940531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:09.228535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a316f8af4f946afa0f62802a8723736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:09.229311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a316f8af4f946afa0f62802a8723736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:09.237547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a316f8af4f946afa0f62802a8723736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:09.253923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a316f8af4f946afa0f62802a8723736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:09.340391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-06afd7ed-c4f8-4d65-9c7b-2da8ffeba30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a316f8af4f946afa0f62802a8723736'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:09.356100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1065/2163] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:08 2022] DELETE /identity/v3/users/3a316f8af4f946afa0f62802a8723736 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:09.568886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:10.238737 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:10.247036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:10.248725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:10.269007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7c68-9e6e-4a7c-be71-978131af878a admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:10.414510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:10.415421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:10.415788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:10.416074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] PATH_INFO: `/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:10.421631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9519beb28cd4620a7b6ba0f4e5398b6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:10.423754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:10.587845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9519beb28cd4620a7b6ba0f4e5398b6', 'request_id': 'req-d025bcb1-ff60-4223-9d94-da4378e5e3f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:10.595688 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9519beb28cd4620a7b6ba0f4e5398b6', 'request_id': 'req-d025bcb1-ff60-4223-9d94-da4378e5e3f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:10.759575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9519beb28cd4620a7b6ba0f4e5398b6', 'request_id': 'req-d025bcb1-ff60-4223-9d94-da4378e5e3f8'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:10.792709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] The token cache is being invalidate because project f9519beb28cd4620a7b6ba0f4e5398b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:10.793043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:10.799215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d025bcb1-ff60-4223-9d94-da4378e5e3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:10.811594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1099/2164] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:10 2022] DELETE /identity/v3/projects/f9519beb28cd4620a7b6ba0f4e5398b6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:10.820100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:10.820645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:10.823584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:10.855625 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:10.857708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:10.965649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1066/2165] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:10.965872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446488b-2444-49d9-b567-53958458096a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:10.966170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446488b-2444-49d9-b567-53958458096a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:10.966454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446488b-2444-49d9-b567-53958458096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.045161 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d446488b-2444-49d9-b567-53958458096a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:11.046429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d446488b-2444-49d9-b567-53958458096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:11.074032 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1100/2166] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:11.092330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.106773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00b260-08cf-46d7-b4b8-87eb59a5b6a8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.120777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.121626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.122009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.122387 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.123657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:11.124082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.126422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.157439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1067/2167] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:11.159633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446488b-2444-49d9-b567-53958458096a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.172923 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446488b-2444-49d9-b567-53958458096a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.179427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.180891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.181226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.181802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.182589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.186122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.306981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1101/2168] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:11 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:11.308174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.319576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b437-de7e-4f56-bece-1afa8b6c6fec admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.464793 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.465978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.466364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.466757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.467577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.469851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.595518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.596715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1068/2169] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:11 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:11.612068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fc3a9-8401-4ecb-9fcf-03450de19eb5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.635922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.638818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.639741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.640274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.641264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.643345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.658145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1102/2170] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:11.662663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.675301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75209e-a317-448d-b3ca-93233c130bfd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.680476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.681412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.683548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.683548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.683548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.684466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af79a9-73f3-4483-8271-e32718c9926a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.696436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1069/2171] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:11.701692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:11.714412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102c36-ab50-4a6a-b95d-f34ce2231ba9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:11.724999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:11.726374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.726668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.727214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] PATH_INFO: `/v3/projects/e46a850a6ae44d90bb42fd3a46f12a1a/users/97e36ea0036e46c3a56ee04071d2a79f/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.754094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46a850a6ae44d90bb42fd3a46f12a1a, user_id=97e36ea0036e46c3a56ee04071d2a79f, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:11.757779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:11.883889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1103/2172] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:11 2022] PUT /identity/v3/projects/e46a850a6ae44d90bb42fd3a46f12a1a/users/97e36ea0036e46c3a56ee04071d2a79f/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:11.895620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c2628-51eb-4643-be25-ae57107e53db None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:11.896694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c2628-51eb-4643-be25-ae57107e53db None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:11.897369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c2628-51eb-4643-be25-ae57107e53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:11.947359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-970c2628-51eb-4643-be25-ae57107e53db None None] MFA Rules not processed for user `97e36ea0036e46c3a56ee04071d2a79f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:11.948817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-970c2628-51eb-4643-be25-ae57107e53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:11.953510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:12.042815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1070/2173] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:12.047061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:12.134992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1e4f-36c9-4b27-b1bf-2b1005d9c1d3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:12.147587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:12.148477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:12.149034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:12.149389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:12.150299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:12.154679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:12.276064 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c2628-51eb-4643-be25-ae57107e53db None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:12.276456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1104/2174] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:12 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:12.288577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c2628-51eb-4643-be25-ae57107e53db None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:12.418039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:12.418962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:12.419401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:12.420119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:12.420996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:12.423850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:12.657745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1071/2175] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:12 2022] POST /identity/v3/users => generated 300 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:12.664898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:12.675433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42580b34-f513-45d8-83db-5de25a7105b8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:12.689387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:12.690273 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:12.690765 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:12.692608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:12.704903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:12.704903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:12.727940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1105/2176] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:12.730393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:12.754027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98e63-d29f-4c5f-83dd-2e85753217d0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:12.772551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:12.773246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:12.773533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:12.775066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] PATH_INFO: `/v3/projects/a73b2073c69a4d31a292f936007c4d2e/users/804201cce66546d1b2fce1e96c4a31cc/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:12.831951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73b2073c69a4d31a292f936007c4d2e, user_id=804201cce66546d1b2fce1e96c4a31cc, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:12.835643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:12.972785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1072/2177] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:12 2022] PUT /identity/v3/projects/a73b2073c69a4d31a292f936007c4d2e/users/804201cce66546d1b2fce1e96c4a31cc/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:12.978356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:12.993486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319f0d-68b7-4b79-87ec-bb8842c12988 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:13.121172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:13.122121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:13.122416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:13.123023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:13.129908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:13.133646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb8be-6e7b-4bf0-890b-d6a5b41c115f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:13.150715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1106/2178] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:13.152977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:13.172563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61b03d-7383-4bab-97c7-546b8199dd4e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:13.184627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:13.187702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:13.187997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:13.190786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] PATH_INFO: `/v3/projects/a73b2073c69a4d31a292f936007c4d2e/users/804201cce66546d1b2fce1e96c4a31cc/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:13.193620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73b2073c69a4d31a292f936007c4d2e, user_id=804201cce66546d1b2fce1e96c4a31cc, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:13.197819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:13.248317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1073/2179] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:13 2022] PUT /identity/v3/projects/a73b2073c69a4d31a292f936007c4d2e/users/804201cce66546d1b2fce1e96c4a31cc/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:13.258830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:13.259204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:13.259555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:13.319205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] MFA Rules not processed for user `804201cce66546d1b2fce1e96c4a31cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:13.322170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:13.409663 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1107/2180] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:13.421550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:13.424215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:13.535052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699b6d-e1df-4926-87f1-8190e3939082 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:13.542550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:13.543521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:13.543828 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:13.544287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:13.561122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:13.565704 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa393-1320-4550-93d6-b535563b8297 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:13.602938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1074/2181] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:13.639406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:13.691909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:13.788075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a285-4e83-4bf4-a1ef-805991af0f37 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:13.796442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:13.797197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:13.797489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:13.797771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] PATH_INFO: `/v3/users/97e36ea0036e46c3a56ee04071d2a79f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:13.799078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e36ea0036e46c3a56ee04071d2a79f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:13.801828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:14.013447 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e36ea0036e46c3a56ee04071d2a79f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:14.025516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e36ea0036e46c3a56ee04071d2a79f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:14.026455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e36ea0036e46c3a56ee04071d2a79f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:14.039478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:14.044763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e36ea0036e46c3a56ee04071d2a79f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:14.045798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e36ea0036e46c3a56ee04071d2a79f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:14.169687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1108/2182] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:13 2022] DELETE /identity/v3/users/97e36ea0036e46c3a56ee04071d2a79f => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:14.174719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6857425-139e-4f7d-889c-49646600af88 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:14.175007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6857425-139e-4f7d-889c-49646600af88 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:14.175281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6857425-139e-4f7d-889c-49646600af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:14.198822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e6857425-139e-4f7d-889c-49646600af88 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:14.200117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6857425-139e-4f7d-889c-49646600af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:14.286903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1075/2183] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:14.316187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:14.317784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:14.501306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0856d0d-ff4f-4d17-a56c-9b35bbd7bdc6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:14.512390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:14.513315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:14.513658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:14.514232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:14.533331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:14.535224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07108451-a519-4eee-9511-46f1e787d95f service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:14.548039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1109/2184] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:14.960169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:15.415082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:15.841652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6857425-139e-4f7d-889c-49646600af88 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:15.844373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e6857425-139e-4f7d-889c-49646600af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:15.867214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6857425-139e-4f7d-889c-49646600af88 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:15.886354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:15.887317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:15.900829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:15.900829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] PATH_INFO: `/v3/projects/e46a850a6ae44d90bb42fd3a46f12a1a` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:15.900829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46a850a6ae44d90bb42fd3a46f12a1a)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:15.900829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:15.915843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:15.916393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:15.916674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:15.958204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] MFA Rules not processed for user `dc296a7422714a068b3abb84b1749434`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:15.960011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:16.066025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1110/2185] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:16.076272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.078960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:16.102614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd485-9ab2-4884-beac-8722fb5920f7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:16.115724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:16.115724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:16.115724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:16.115724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:16.117088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:16.117088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:16.137304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46a850a6ae44d90bb42fd3a46f12a1a', 'request_id': 'req-dcaa084e-07fe-4580-aca4-366487f244b4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.145454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46a850a6ae44d90bb42fd3a46f12a1a', 'request_id': 'req-dcaa084e-07fe-4580-aca4-366487f244b4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.222922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46a850a6ae44d90bb42fd3a46f12a1a', 'request_id': 'req-dcaa084e-07fe-4580-aca4-366487f244b4'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.233491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1111/2186] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:16 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:38:16.239387 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.242851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] The token cache is being invalidate because project e46a850a6ae44d90bb42fd3a46f12a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:16.243144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.247148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.248894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1076/2187] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:15 2022] DELETE /identity/v3/projects/e46a850a6ae44d90bb42fd3a46f12a1a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:16.253508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.256255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:16.341220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c742de-c825-411e-a7a9-41650751e040 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:16.349397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:16.364235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa084e-07fe-4580-aca4-366487f244b4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:16.366993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:16.367588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:16.367883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:16.368613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:16.370554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:16.378301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:16.378301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:16.378301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:16.378301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] PATH_INFO: `/v3/users/804201cce66546d1b2fce1e96c4a31cc` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:16.378634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=804201cce66546d1b2fce1e96c4a31cc)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:16.378634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:16.513862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1112/2188] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:16 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:38:16.517559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.521481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:16.537608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b342-74d1-4945-b245-a42eecddb24d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:16.543512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:16.544692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:16.544692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:16.544952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:16.545626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:16.547264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:16.559791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1113/2189] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:38:16.563872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.575409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf489a9-123e-48cc-a651-38900779152c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:16.580951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:16.581831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:16.582125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:16.582681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] PATH_INFO: `/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84/users/aec43d700da048ab986b4f789b740e77/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:16.601451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae93f572c2a4eab8e1f0656ac05ca84, user_id=aec43d700da048ab986b4f789b740e77, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:16.604228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:16.615639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804201cce66546d1b2fce1e96c4a31cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.616578 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804201cce66546d1b2fce1e96c4a31cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.624908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804201cce66546d1b2fce1e96c4a31cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.641405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804201cce66546d1b2fce1e96c4a31cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.720474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1114/2190] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:16 2022] PUT /identity/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84/users/aec43d700da048ab986b4f789b740e77/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:16.724618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:16.752417 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804201cce66546d1b2fce1e96c4a31cc'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:16.769034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1077/2191] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:16 2022] DELETE /identity/v3/users/804201cce66546d1b2fce1e96c4a31cc => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:16.959728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175b086-954f-4faf-86f2-2bbd95f45c7d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:17.044500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:17.045266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:17.049469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:17.049469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:17.049469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:17.049469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:17.062791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1115/2192] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:38:17.063839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:17.065458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:17.081655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344080dc-ddee-40e3-910e-510fba8cac0b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:17.093028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:17.093719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:17.094000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:17.094481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] PATH_INFO: `/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84/users/aec43d700da048ab986b4f789b740e77/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:17.098276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae93f572c2a4eab8e1f0656ac05ca84, user_id=aec43d700da048ab986b4f789b740e77, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:17.102244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff054f-2000-4d3e-b6ff-9fc905ad094e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:17.123269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1078/2193] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:17 2022] PUT /identity/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84/users/aec43d700da048ab986b4f789b740e77/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:17.290894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:17.879360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:17.917985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:17.917985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:17.941919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916e42-d5d7-4b72-8f0b-88cac4b232e6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:18.067400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:18.068358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:18.068873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:18.069330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] PATH_INFO: `/v3/projects/a73b2073c69a4d31a292f936007c4d2e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:18.072335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73b2073c69a4d31a292f936007c4d2e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:18.074702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:18.291103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73b2073c69a4d31a292f936007c4d2e', 'request_id': 'req-2167a76e-49a8-4a83-acb6-6f0245e4316b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:18.297285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73b2073c69a4d31a292f936007c4d2e', 'request_id': 'req-2167a76e-49a8-4a83-acb6-6f0245e4316b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:18.375423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73b2073c69a4d31a292f936007c4d2e', 'request_id': 'req-2167a76e-49a8-4a83-acb6-6f0245e4316b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:18.395882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] The token cache is being invalidate because project a73b2073c69a4d31a292f936007c4d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:18.396768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:18.397549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2167a76e-49a8-4a83-acb6-6f0245e4316b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:18.400125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1116/2194] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:17 2022] DELETE /identity/v3/projects/a73b2073c69a4d31a292f936007c4d2e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:18.405154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:18.405677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:18.407750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:18.431137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:18.432491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:18.501728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1079/2195] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:18.512217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:18.514181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:18.514618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:18.540369 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:18.541690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:18.551059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1117/2196] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:18.556825 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:18.566226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069471-20d7-4641-954a-b90d37feca82 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:18.572103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:18.572807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:18.573312 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:18.573743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:18.574412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:18.574714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:18.576668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:18.596030 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1080/2197] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:18.596867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:18.608511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892915-87a3-412f-b17a-a83c89f40502 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:18.614444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:18.615231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:18.615849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:18.616267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:18.616918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:18.619286 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.151243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1118/2198] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:18 2022] POST /identity/v3/projects => generated 399 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:19.155606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.171787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a38b-3963-42cf-9460-0006eb58ef52 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:19.317110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:19.317741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.318027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.318303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.318951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:19.321773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.447176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1081/2199] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:19 2022] POST /identity/v3/users => generated 300 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:19.451467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.463471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701ce0-7355-4719-91f6-c13ceacbf3dd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:19.470189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:19.470962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.471254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.471566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.472357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:19.473981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.485591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1119/2200] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:38:19.503258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.503258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1197-e1ae-4cde-a516-222fbdc1ac18 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:19.510639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:19.511348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.511661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.513926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.514612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:19.516505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdc3d-3a16-4e45-9126-5ae49d56fa66 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.528540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1082/2201] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:19.532880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.543441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869524-d249-40d1-adb8-afd3c7a1ece1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:19.547816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:19.548473 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.548755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.549033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] PATH_INFO: `/v3/projects/7b59c9856a3540889b13d3c04d480939/users/3890899fad2944ed825bc6d1fe5eaf1d/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.567953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b59c9856a3540889b13d3c04d480939, user_id=3890899fad2944ed825bc6d1fe5eaf1d, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:19.571683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.687069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1120/2202] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:19 2022] PUT /identity/v3/projects/7b59c9856a3540889b13d3c04d480939/users/3890899fad2944ed825bc6d1fe5eaf1d/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:19.698545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.699004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.699287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.727116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] MFA Rules not processed for user `3890899fad2944ed825bc6d1fe5eaf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:19.728366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:19.792992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1083/2203] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:19.797681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.859958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24059fa6-0694-43d3-b033-ce7769079be0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:19.864667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:19.865329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:19.865612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:19.865888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:19.866530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:19.869087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:19.975522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1121/2204] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:19 2022] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:19.980240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:19.996266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2012ac-3e13-49d8-a810-b2a477bf5236 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.064622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.065239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.065690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.066069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.066738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.068698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.073220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:20.174831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1084/2205] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:19 2022] POST /identity/v3/users => generated 306 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:20.176129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:20.194245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773ae1-7f27-431f-a791-4f5d514bb5e7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.201993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.202734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.203120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.203522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.204445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.207177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.237838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1122/2206] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:20.245218 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:20.258677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecaa64-010d-4a34-85ac-488273b163dc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.268688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.269369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.269655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.272511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] PATH_INFO: `/v3/projects/61cbd0538cfa4df395bd3b6938db63cf/users/5dc5044131ab403ebf2f4dcc17412db3/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.309590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cbd0538cfa4df395bd3b6938db63cf, user_id=5dc5044131ab403ebf2f4dcc17412db3, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.312389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.427322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1085/2207] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:20 2022] PUT /identity/v3/projects/61cbd0538cfa4df395bd3b6938db63cf/users/5dc5044131ab403ebf2f4dcc17412db3/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:20.431366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:20.446804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472c95-e430-406e-92e4-4eb04704aa4e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.527276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.528013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.528363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.528715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.529639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.531530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd0d61-92f0-4d8c-885b-20245aa70a8e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.547029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1123/2208] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:20.547523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:20.577109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f360e-f8f9-47b0-b944-de0f2123740a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.586416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.587003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.587190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.587468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] PATH_INFO: `/v3/projects/61cbd0538cfa4df395bd3b6938db63cf/users/5dc5044131ab403ebf2f4dcc17412db3/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.589687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cbd0538cfa4df395bd3b6938db63cf, user_id=5dc5044131ab403ebf2f4dcc17412db3, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.592572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.609042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1086/2209] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:20 2022] PUT /identity/v3/projects/61cbd0538cfa4df395bd3b6938db63cf/users/5dc5044131ab403ebf2f4dcc17412db3/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:20.617639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.617935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.618234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.651512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] MFA Rules not processed for user `5dc5044131ab403ebf2f4dcc17412db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:20.652736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:20.770635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1124/2210] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:20.784831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:20.786902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:20.872145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b06d-31d1-4d33-9fa8-9dd7cc80bb64 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:20.875991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:20.877382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:20.877668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:20.877949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:20.888761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:20.896431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb882f4-d20f-464b-b4dd-ac8f6d93c609 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:20.909736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1087/2211] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:21.261380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:21.264187 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:21.284926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75ca2-1aba-4a0c-8aa0-4b659ed30a0f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:21.292229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:21.293386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:21.294504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:21.295059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:21.410922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:21.411816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:21.428406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1125/2212] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:24.471512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:25.353922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:26.021725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6964-3ddc-4585-97e9-6dc028631e67 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:26.024994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6964-3ddc-4585-97e9-6dc028631e67 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:26.024994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6964-3ddc-4585-97e9-6dc028631e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:26.097059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-e0ff6964-3ddc-4585-97e9-6dc028631e67 None None] MFA Rules not processed for user `aec43d700da048ab986b4f789b740e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:26.099999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e0ff6964-3ddc-4585-97e9-6dc028631e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:26.188389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1088/2213] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:26.202328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:26.204348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:26.319789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5e8ae-d3c3-456e-82c7-773fa813f7bd service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:26.324817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:26.325445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:26.325767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:26.326043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:26.328316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:26.453559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:26.455370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:26.468558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1126/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:26.882686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:26.888595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:26.888595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:26.909372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:26.910559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:27.007796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1089/2215] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:27.065287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:27.066474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:27.175415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2202084-14cc-44e6-bf9a-5946716d6e0b service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:27.180496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:27.181351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:27.181794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:27.182355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:27.194966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:27.194966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16821765-f3e4-4a2e-9ad1-37b255c57a84 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:27.207917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1127/2216] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:38:27.712553 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:27.976994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:28.088247 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab777e-0ce0-4070-8f2e-045ec88f8033 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:28.090102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:28.098252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:28.099430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:28.100036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:28.100422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] PATH_INFO: `/v3/users/3890899fad2944ed825bc6d1fe5eaf1d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:28.102585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3890899fad2944ed825bc6d1fe5eaf1d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:28.104976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:28.259045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf307-1222-4bb1-ad34-5afe2a5d7fce None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:28.260181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf307-1222-4bb1-ad34-5afe2a5d7fce None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:28.260640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf307-1222-4bb1-ad34-5afe2a5d7fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:28.283729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-34dcf307-1222-4bb1-ad34-5afe2a5d7fce None None] MFA Rules not processed for user `a0a1588ce02044c183ea0e2fea20e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:28.285265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-34dcf307-1222-4bb1-ad34-5afe2a5d7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:28.355918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3890899fad2944ed825bc6d1fe5eaf1d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:28.357932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3890899fad2944ed825bc6d1fe5eaf1d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:28.374397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1128/2217] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:28.389908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3890899fad2944ed825bc6d1fe5eaf1d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:28.459602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3890899fad2944ed825bc6d1fe5eaf1d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:28.558401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3890899fad2944ed825bc6d1fe5eaf1d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:28.575224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:28.575517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:28.575875 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:28.579005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1090/2218] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:27 2022] DELETE /identity/v3/users/3890899fad2944ed825bc6d1fe5eaf1d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:28.612902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:28.617818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:28.774245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1129/2219] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:28.793933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:28.799265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:29.028440 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a3a7-bb24-4c62-ab41-f8e281b131e7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:29.034233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:29.035686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:29.036504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:29.037026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:29.056324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:29.058497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:29.071623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1091/2220] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:30.003023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:30.221336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:30.222800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:30.242793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d772-8242-46c5-adf0-b175fabf1466 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:30.254910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:30.255788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:30.256071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:30.256344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] PATH_INFO: `/v3/projects/7b59c9856a3540889b13d3c04d480939` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:30.258842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b59c9856a3540889b13d3c04d480939)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:30.261002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:30.346001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:30.468756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b59c9856a3540889b13d3c04d480939', 'request_id': 'req-c7067a7f-9147-4ab9-8215-fa1bddec222f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:30.476458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b59c9856a3540889b13d3c04d480939', 'request_id': 'req-c7067a7f-9147-4ab9-8215-fa1bddec222f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:30.545019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b59c9856a3540889b13d3c04d480939', 'request_id': 'req-c7067a7f-9147-4ab9-8215-fa1bddec222f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:30.571927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] The token cache is being invalidate because project 7b59c9856a3540889b13d3c04d480939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:30.572630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:30.574322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:30.580213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1130/2221] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:30 2022] DELETE /identity/v3/projects/7b59c9856a3540889b13d3c04d480939 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:30.580876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:30.601045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396648b-9f8f-436f-9d69-172a1f4f20c4 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:30.769231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:30.770065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:30.770635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:30.771215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] PATH_INFO: `/v3/users/5dc5044131ab403ebf2f4dcc17412db3` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:30.772905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc5044131ab403ebf2f4dcc17412db3)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:30.779768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:31.070749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc5044131ab403ebf2f4dcc17412db3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:31.073484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc5044131ab403ebf2f4dcc17412db3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:31.090467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc5044131ab403ebf2f4dcc17412db3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:31.139826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc5044131ab403ebf2f4dcc17412db3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:31.227014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9164e55c-a505-405b-b0e1-f81d263605ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc5044131ab403ebf2f4dcc17412db3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:31.248921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1092/2222] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:30 2022] DELETE /identity/v3/users/5dc5044131ab403ebf2f4dcc17412db3 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:32.376001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:32.428622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:32.430484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:32.469604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067a7f-9147-4ab9-8215-fa1bddec222f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:32.556478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:32.557128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:32.557615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:32.557891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] PATH_INFO: `/v3/projects/61cbd0538cfa4df395bd3b6938db63cf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:32.559637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cbd0538cfa4df395bd3b6938db63cf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:32.562226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:32.696836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:32.772518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cbd0538cfa4df395bd3b6938db63cf', 'request_id': 'req-37806314-d5f1-45f5-9ef2-34cb69377656'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:32.785396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cbd0538cfa4df395bd3b6938db63cf', 'request_id': 'req-37806314-d5f1-45f5-9ef2-34cb69377656'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:32.889283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cbd0538cfa4df395bd3b6938db63cf', 'request_id': 'req-37806314-d5f1-45f5-9ef2-34cb69377656'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:32.909242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] The token cache is being invalidate because project 61cbd0538cfa4df395bd3b6938db63cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:32.909830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:32.911169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37806314-d5f1-45f5-9ef2-34cb69377656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:32.915529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1131/2223] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:32 2022] DELETE /identity/v3/projects/61cbd0538cfa4df395bd3b6938db63cf => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:32.926328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:32.926328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:32.926328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:32.959749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:32.961585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:33.121763 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1093/2224] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:33.136440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:33.136718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:33.136997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:33.162236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:33.164125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:33.186995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:33.203390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1132/2225] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:33.204124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604609-a37b-40f6-a1f6-1d42c72355fc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:33.211878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:33.212607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:33.212966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:33.213318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:33.214216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:33.214589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:33.217613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:33.278725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1094/2226] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:33.300438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:33.349564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9e071-f44e-4443-8a7a-4662408b250d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:33.374323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:33.378252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:33.378252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:33.378252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:33.378252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:33.379175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:33.815141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1133/2227] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:33 2022] POST /identity/v3/projects => generated 365 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:33.819371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:33.830106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75758c1c-2441-4dac-9240-91bef55bb3b2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:33.893319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:33.904752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:33.905567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:33.906482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:33.907787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:33.909910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:34.046770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1095/2228] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:33 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:34.051009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:34.065557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ce2a-7bcc-4a78-b396-601aca9f9d5e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:34.072086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:34.072853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.073231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.073750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.074828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:34.077459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:34.093191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1134/2229] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:34.097113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:34.118846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e6376-4c80-43f5-aef2-12a8ce37270a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:34.125610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:34.128058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.128506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.129610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.130585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:34.132397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b1eee-669d-4b6b-bbc5-2b5c443c20d9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:34.148320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1096/2230] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:34.153465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:34.168607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d99c-85f7-4f97-a5a1-22db5bab72bd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:34.172307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:34.172972 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.173258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.173536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] PATH_INFO: `/v3/projects/29a72aff908d442b95af88a217b9ff31/users/2b24025826334223a0a82920fd375d4b/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.188484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.188777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.189067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.219517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] MFA Rules not processed for user `99334ff226424a3ab1457e88ff21fe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:34.221641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:34.224452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a72aff908d442b95af88a217b9ff31, user_id=2b24025826334223a0a82920fd375d4b, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:34.227122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb837f8-1c26-4309-89c2-2cded71c6481 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:34.305787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1135/2231] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:34 2022] PUT /identity/v3/projects/29a72aff908d442b95af88a217b9ff31/users/2b24025826334223a0a82920fd375d4b/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:34.316472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.316822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.317200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.332940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1097/2232] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:34.427131 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] MFA Rules not processed for user `2b24025826334223a0a82920fd375d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:34.434943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:34.555063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1136/2233] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:34.565205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:34.579947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19aa2-4e3a-4fe6-9ac3-8348cc6dfc6e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:34.676795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:34.677554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.677937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.678282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.691203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:34.692071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:34.693932 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:34.801018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1098/2234] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:34 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:34.802437 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:34.822773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9705e7-adfc-4a1d-888c-909ada55d114 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:34.925289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:34.928713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:34.929816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:34.930338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:34.932703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:34.936399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.092950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1137/2235] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:34 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:35.094338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:35.114129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639fdcf-b176-4b22-a45d-bd05eedca57a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:35.124370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:35.125006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.125281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.128576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.132503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:35.134819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.156647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1099/2236] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:35.157874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:35.183515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754caa-c475-480c-b258-bd946437cb4c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:35.212091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:35.212897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.217296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.217625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] PATH_INFO: `/v3/projects/938201c84ed44077a53f821a021a29f6/users/c26c3a5eb4f8416fac28cf608119d09e/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.271763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938201c84ed44077a53f821a021a29f6, user_id=c26c3a5eb4f8416fac28cf608119d09e, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:35.274790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.368410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1138/2237] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:35 2022] PUT /identity/v3/projects/938201c84ed44077a53f821a021a29f6/users/c26c3a5eb4f8416fac28cf608119d09e/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:35.370078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:35.383315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141d68-577e-4353-8d15-c5c6af18fccf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:35.460619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:35.461241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.461533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.462503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.463174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:35.465550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aac7f0-3d83-4847-8b37-deaa4e5895c0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.495313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1100/2238] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:35.496492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:35.508679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22812a-805c-4b5b-9072-d93cd4e65bf2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:35.520883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:35.521564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.523471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.523471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] PATH_INFO: `/v3/projects/938201c84ed44077a53f821a021a29f6/users/c26c3a5eb4f8416fac28cf608119d09e/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.526666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938201c84ed44077a53f821a021a29f6, user_id=c26c3a5eb4f8416fac28cf608119d09e, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:35.529738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.552167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1139/2239] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:35 2022] PUT /identity/v3/projects/938201c84ed44077a53f821a021a29f6/users/c26c3a5eb4f8416fac28cf608119d09e/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:35.561052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.561711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.562133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.623219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] MFA Rules not processed for user `c26c3a5eb4f8416fac28cf608119d09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:35.624624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:35.738647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1101/2240] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:35.757535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:35.759556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:35.866401 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce3103-6968-423d-af62-fca2d7665189 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:35.872822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:35.874456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:35.875082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:35.875520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:35.887811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:35.889398 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:35.918694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1140/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:35.924390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:36.140808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:36.156006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed777a1-3366-4d80-9009-fdadce728bb5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:36.169812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:36.170075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:36.170265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:36.170498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:36.260634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:36.262471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:36.273456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1102/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:36.472393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:37.617309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:38.267586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:40.181210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:40.725760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:40.727275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:40.891771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39f57-b49c-4fe4-a0a1-16b60b9c735f service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:40.898040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:40.898788 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:40.899109 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:40.899390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] PATH_INFO: `/v3/users/60e561f003ef43d1909ffdd415257fff` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:40.901389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e561f003ef43d1909ffdd415257fff)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:40.909158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:41.264820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:41.308657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e561f003ef43d1909ffdd415257fff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:41.320443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e561f003ef43d1909ffdd415257fff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:41.321312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e561f003ef43d1909ffdd415257fff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:41.372545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e561f003ef43d1909ffdd415257fff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:41.375902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e561f003ef43d1909ffdd415257fff'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:41.485021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1141/2243] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:40 2022] DELETE /identity/v3/users/60e561f003ef43d1909ffdd415257fff => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:41.821050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:41.941409 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:42.104056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:42.118719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12d57-88b1-4e1e-b93c-d938681362ea service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:42.240015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:42.240890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:42.241678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:42.242044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] PATH_INFO: `/v3/projects/92daa7cda7144b2ba1d10c6cd3407b19` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:42.244733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92daa7cda7144b2ba1d10c6cd3407b19)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:42.248912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:42.434627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92daa7cda7144b2ba1d10c6cd3407b19', 'request_id': 'req-b256bd86-9cef-4235-a5b8-77fdc6b45694'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:42.445967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92daa7cda7144b2ba1d10c6cd3407b19', 'request_id': 'req-b256bd86-9cef-4235-a5b8-77fdc6b45694'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:42.649202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92daa7cda7144b2ba1d10c6cd3407b19', 'request_id': 'req-b256bd86-9cef-4235-a5b8-77fdc6b45694'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:42.680643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] The token cache is being invalidate because project 92daa7cda7144b2ba1d10c6cd3407b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:42.680947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:42.688069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:42.691907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1103/2244] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:42 2022] DELETE /identity/v3/projects/92daa7cda7144b2ba1d10c6cd3407b19 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:42.696518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:42.699327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:42.728565 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad30-b2ea-47c8-97e7-476f7c3cd392 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:42.855422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:42.856093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:42.856379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:42.856658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] PATH_INFO: `/v3/users/af5604234af64a319c513c4bc47ee923` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:42.868462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5604234af64a319c513c4bc47ee923)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:42.870953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:43.151568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5604234af64a319c513c4bc47ee923'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:43.159041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:43.166907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5604234af64a319c513c4bc47ee923'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:43.168082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5604234af64a319c513c4bc47ee923'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:43.197659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5604234af64a319c513c4bc47ee923'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:43.199014 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d53ef325-b20e-431e-8e36-02864ee51ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5604234af64a319c513c4bc47ee923'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:43.272587 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1142/2245] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:42 2022] DELETE /identity/v3/users/af5604234af64a319c513c4bc47ee923 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:44.486216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:44.488224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:44.511138 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256bd86-9cef-4235-a5b8-77fdc6b45694 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:44.531874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:44.532754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:44.533189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:44.567634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:44.571430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:44.645485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:44.646467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:44.646914 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:44.654423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] PATH_INFO: `/v3/projects/2ff90e568189446691fa9f931b67aa6f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:44.666454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff90e568189446691fa9f931b67aa6f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:44.673436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:44.717491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1143/2246] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:38:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:44.724054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:44.725584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:44.860379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff90e568189446691fa9f931b67aa6f', 'request_id': 'req-b586f27c-8901-485f-8f40-76b23ec48430'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:44.870334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff90e568189446691fa9f931b67aa6f', 'request_id': 'req-b586f27c-8901-485f-8f40-76b23ec48430'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:44.887986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584655aa-d8d1-4e31-bb28-3ff31c1fb388 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:44.982573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:44.983635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff90e568189446691fa9f931b67aa6f', 'request_id': 'req-b586f27c-8901-485f-8f40-76b23ec48430'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.002066 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] The token cache is being invalidate because project 2ff90e568189446691fa9f931b67aa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:45.004885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.006400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b586f27c-8901-485f-8f40-76b23ec48430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.021510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1104/2247] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:44 2022] DELETE /identity/v3/projects/2ff90e568189446691fa9f931b67aa6f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:45.021510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.021510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.021510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.046636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:45.049354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:45.060901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:45.061543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.061830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.062113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.080742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:45.194548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:45.196477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43954ae-4a7d-4fcf-948f-e6fe12d011c9 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:45.216567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1144/2248] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:38:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 16:38:45.236979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1105/2249] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:45.238792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.239246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.239721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.273632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:45.283388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:45.320071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1145/2250] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:45.324757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:45.337718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8b4a-8a1b-47b2-8de2-e9ef83d26637 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:45.360503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:45.360503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.360815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.361071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.361812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:45.362079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:45.395905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:45.437730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1106/2251] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:45.442162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:45.461452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a8746-47d4-4cb4-86ee-35ca68d1642a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:45.469705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:45.470556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.471019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.471516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.472357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:45.474541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:45.546073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:45.548184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:45.562097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e30-60b2-4bdc-9764-5fcbb12c31f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:45.568961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:45.569856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.570359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.571445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] PATH_INFO: `/v3/users/2b24025826334223a0a82920fd375d4b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.577274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b24025826334223a0a82920fd375d4b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:45.579870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:45.614725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:45.752646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1146/2252] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:45.753581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:45.861060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6198f04-2ad0-4b2f-830c-fb73f03ddb42 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:45.867821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:45.869655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.870173 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.871094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:45.872031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:45.874370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8af51-e078-4e88-9a29-d0ed7dbe7ffe admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:45.907823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b24025826334223a0a82920fd375d4b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.908660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b24025826334223a0a82920fd375d4b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.917776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b24025826334223a0a82920fd375d4b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.939249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b24025826334223a0a82920fd375d4b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:45.984477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1147/2253] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:45 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:45.989184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32fdf-47b5-41ef-8438-d4a076ebbbbd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:45.990723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32fdf-47b5-41ef-8438-d4a076ebbbbd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:45.992078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d32fdf-47b5-41ef-8438-d4a076ebbbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.015698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b24025826334223a0a82920fd375d4b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:46.023519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1107/2254] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:45 2022] DELETE /identity/v3/users/2b24025826334223a0a82920fd375d4b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:38:46.024633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:46.025240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-62d32fdf-47b5-41ef-8438-d4a076ebbbbd None None] MFA Rules not processed for user `e2d6c76ba6c34f219faf59f9dd1b1fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:46.027260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62d32fdf-47b5-41ef-8438-d4a076ebbbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.027556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.101929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1148/2255] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:46.103996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.104552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.105145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.143139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667f63-8ed7-46c8-842c-cfbb019bffe8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:46.173625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:46.177156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:46.177798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.178088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.178367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.183632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:46.190258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:46.195337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.234188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1108/2256] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:46.236612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:46.252501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1149/2257] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:46.259966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:46.262463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.270317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bec69-4a83-4c19-bfbb-ce01b831ce47 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:46.285077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:46.285888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.286348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.286789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.287631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:46.289525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:46.325670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1109/2258] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:46.328128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:46.353823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33067-419e-4663-a983-905380fddb1b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:46.374348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:46.375650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.376160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.376661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] PATH_INFO: `/v3/projects/d99fb474085e448ead6bb902145fae99/users/8f0d66339ede4c30907432e642d384b7/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.402382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99fb474085e448ead6bb902145fae99, user_id=8f0d66339ede4c30907432e642d384b7, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:46.406196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f73b8-cfde-4492-b79b-7d257bccffb5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:46.442059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5a02e-5179-449a-874b-256cb3659183 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:46.454194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:46.456693 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.460377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.460377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.472172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:46.474488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:46.485508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1110/2259] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:46 2022] PUT /identity/v3/projects/d99fb474085e448ead6bb902145fae99/users/8f0d66339ede4c30907432e642d384b7/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:46.486260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1150/2260] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:46.499211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743366-c922-48df-b873-0e79ede95610 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.499727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743366-c922-48df-b873-0e79ede95610 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.500193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743366-c922-48df-b873-0e79ede95610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.544143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a6743366-c922-48df-b873-0e79ede95610 None None] MFA Rules not processed for user `8f0d66339ede4c30907432e642d384b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:46.546227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a6743366-c922-48df-b873-0e79ede95610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.650574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1111/2261] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:46.661709 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:46.683637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.822148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd370-bf8c-4423-99bf-db8a852b4573 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:46.908614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.908614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.908928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.950714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:46.951631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:46.952604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] MFA Rules not processed for user `dc296a7422714a068b3abb84b1749434`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:46.953050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:46.954018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:46.955583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:46.992503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:46.996114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:47.015435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1151/2262] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:47.066814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1112/2263] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:47.118351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:47.173782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:47.175806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:47.231833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:47.321836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ebaf-8b93-4db5-bc85-ce784ed9705e service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:47.336524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:47.338523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:47.339446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:47.339754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] PATH_INFO: `/v3/projects/29a72aff908d442b95af88a217b9ff31` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:47.343384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a72aff908d442b95af88a217b9ff31)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:47.349282 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:47.558714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a72aff908d442b95af88a217b9ff31', 'request_id': 'req-29f8047a-cd5f-415e-b37d-ff39c2d85435'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:47.581626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a72aff908d442b95af88a217b9ff31', 'request_id': 'req-29f8047a-cd5f-415e-b37d-ff39c2d85435'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:47.660721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a72aff908d442b95af88a217b9ff31', 'request_id': 'req-29f8047a-cd5f-415e-b37d-ff39c2d85435'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:47.678082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] The token cache is being invalidate because project 29a72aff908d442b95af88a217b9ff31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:47.679127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:47.681110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:47.686628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1152/2264] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:47 2022] DELETE /identity/v3/projects/29a72aff908d442b95af88a217b9ff31 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:47.692213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:47.712958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3b23f-d3b1-4d0a-a49b-2350973815a0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:47.858804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:47.859757 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:47.860934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:47.866891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] PATH_INFO: `/v3/users/c26c3a5eb4f8416fac28cf608119d09e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:47.878487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26c3a5eb4f8416fac28cf608119d09e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:47.883718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:48.189665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26c3a5eb4f8416fac28cf608119d09e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:48.190851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26c3a5eb4f8416fac28cf608119d09e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:48.199946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26c3a5eb4f8416fac28cf608119d09e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:48.222324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26c3a5eb4f8416fac28cf608119d09e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:48.335461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a5858cb4-9eac-45c9-afa7-0d5cfe3474b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26c3a5eb4f8416fac28cf608119d09e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:48.344970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1113/2265] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:47 2022] DELETE /identity/v3/users/c26c3a5eb4f8416fac28cf608119d09e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:49.152619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:49.154090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:49.191374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8047a-cd5f-415e-b37d-ff39c2d85435 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:49.349069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:49.397584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:49.398157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:49.398480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:49.398733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] PATH_INFO: `/v3/projects/938201c84ed44077a53f821a021a29f6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:49.400522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=938201c84ed44077a53f821a021a29f6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:49.402440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:49.443694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:50.458210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938201c84ed44077a53f821a021a29f6', 'request_id': 'req-87aee92a-87ae-430a-8803-6d86ca7d0e3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:50.492075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938201c84ed44077a53f821a021a29f6', 'request_id': 'req-87aee92a-87ae-430a-8803-6d86ca7d0e3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:50.660615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938201c84ed44077a53f821a021a29f6', 'request_id': 'req-87aee92a-87ae-430a-8803-6d86ca7d0e3d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:50.686055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] The token cache is being invalidate because project 938201c84ed44077a53f821a021a29f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:38:50.687431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:50.690245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-87aee92a-87ae-430a-8803-6d86ca7d0e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:50.696099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1153/2266] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:49 2022] DELETE /identity/v3/projects/938201c84ed44077a53f821a021a29f6 => generated 0 bytes in 1540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:50.697836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:50.698683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:50.699147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:50.734311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:50.735790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:50.833135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1114/2267] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:50.836810 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:50.848137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:50.848137 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:50.868225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:50.871021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:50.891154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1154/2268] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:50.895612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:50.910534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450eb5-f271-4eef-a34f-8f54e959d484 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:50.926537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:50.927408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:50.927713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:50.927988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:50.929098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:38:50.929352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:50.930985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:50.961730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1115/2269] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:38:50.963460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:50.976800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9dff-6013-46ed-9b63-5098b71b98d7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:50.984376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:50.987527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:50.988896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:50.989550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:50.990701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:50.993185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:51.078201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:51.180181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1155/2270] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:38:50 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:51.185747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:51.203236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3d020-0acd-4743-ba3b-4243e81d552c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:51.386666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:51.387581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:51.388178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:51.401462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:51.406621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:51.415267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:51.533932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:51.602022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:51.611278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1116/2271] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:38:51 2022] POST /identity/v3/users => generated 285 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:38:51.616377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856ae1-0437-4754-94b1-774c6fb87b91 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:51.632971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:51.634020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:51.635070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:51.635718 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:51.636865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:51.638987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:51.665170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1156/2272] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:38:51.669044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:51.683413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1b56-465e-4570-a41d-200d1c5c7da2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:51.690814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:51.691430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:51.691811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:51.692405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:51.698305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:51.698305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d812-7258-44e9-885a-603d012d1426 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:51.715878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1117/2273] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:38:51.720891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:51.736314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d202-5fc8-453d-93ed-13156c3c7dae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:51.746852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:51.746852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:51.746852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:51.746852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] PATH_INFO: `/v3/projects/e63255bc819245bf9fe56413ac38f27a/users/0dfaf39e484c4be7839aea6e896a32eb/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:51.767028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63255bc819245bf9fe56413ac38f27a, user_id=0dfaf39e484c4be7839aea6e896a32eb, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:51.770176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:51.882568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:51.883004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:51.883139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:51.883371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1157/2274] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:38:51 2022] PUT /identity/v3/projects/e63255bc819245bf9fe56413ac38f27a/users/0dfaf39e484c4be7839aea6e896a32eb/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:51.935571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] MFA Rules not processed for user `0dfaf39e484c4be7839aea6e896a32eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:51.936820 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:52.121192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1118/2275] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:38:52.133335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:52.136930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:52.180727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:52.270357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14482-0d10-43d3-884b-2bd6611d732e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:52.275850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:52.276949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:52.277445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:52.277937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:52.299524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:52.305671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7db86-9b95-4706-a28a-6fafda093c06 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:52.331624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1158/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:53.614383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:54.380298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:55.763211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:56.769283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:57.717657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:58.117198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:58.204453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ca1a-38a5-4bc9-bdad-cc5bca52f289 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:58.213892 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:58.214559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:58.216668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:58.217039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] PATH_INFO: `/v3/users/0dfaf39e484c4be7839aea6e896a32eb` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:58.221771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfaf39e484c4be7839aea6e896a32eb)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:58.225524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:58.447109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfaf39e484c4be7839aea6e896a32eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:58.447109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfaf39e484c4be7839aea6e896a32eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:58.454225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfaf39e484c4be7839aea6e896a32eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:58.470884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfaf39e484c4be7839aea6e896a32eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:58.551595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfaf39e484c4be7839aea6e896a32eb'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:38:58.563615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1119/2277] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:38:58 2022] DELETE /identity/v3/users/0dfaf39e484c4be7839aea6e896a32eb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:38:58.563868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:58.568153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:58.568153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:58.604287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:38:58.605606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:58.648944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:58.748274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1159/2278] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:38:58.779237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:58.780939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:58.893364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee04c-b250-4c9b-ad27-88edfda8831a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:58.903410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:58.904405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:58.904547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:58.904813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:58.924303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:58.928287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca735a-85ba-4fa1-a48e-e5918e13ff9f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:38:58.944168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1120/2279] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:38:58.991954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:59.025972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:59.806646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:38:59.811416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:38:59.829808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e457b-b620-43d3-ac81-5cfefc0aa7b4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:38:59.834158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:38:59.834968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:38:59.835509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:38:59.835904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] PATH_INFO: `/v3/projects/e63255bc819245bf9fe56413ac38f27a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:38:59.837981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63255bc819245bf9fe56413ac38f27a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:38:59.840295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:00.070632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63255bc819245bf9fe56413ac38f27a', 'request_id': 'req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:00.070632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63255bc819245bf9fe56413ac38f27a', 'request_id': 'req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:00.448567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63255bc819245bf9fe56413ac38f27a', 'request_id': 'req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:00.452236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] The token cache is being invalidate because project e63255bc819245bf9fe56413ac38f27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:39:00.452534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:00.453192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6e25f69c-c8ba-4b29-9585-d5f0c5faa2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:00.454870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1160/2280] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:38:59 2022] DELETE /identity/v3/projects/e63255bc819245bf9fe56413ac38f27a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:00.463299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:00.463299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:00.463299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:00.484341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:00.485688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:00.555620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1121/2281] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:00.642949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:00.643212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:00.643390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:00.670185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:00.671430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:00.686800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1161/2282] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:00.691161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:00.703081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae6ec-662f-4469-b3eb-82f0f01a6684 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:00.708077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:00.708694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:00.708977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:00.709258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:00.709915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:39:00.710224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:00.711879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:00.724364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1122/2283] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:39:00.729449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:00.744100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa40b-3c1f-4ca2-9d47-2967e115e5f3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:00.749129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:00.749868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:00.750165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:00.750453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:00.751213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:00.759823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:00.874498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1162/2284] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:39:00 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:39:00.883372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:00.898034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbbfa-9337-4a06-a923-0f6dabf8ee8f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:00.985069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:00.985817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:00.986514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:00.986899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:00.987842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:00.990583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:01.126824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1123/2285] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:39:00 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:39:01.132664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:01.151790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4617-8ae6-4e33-b72c-0621e9c28671 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:01.159373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:01.160246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:01.160532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:01.160812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:01.161656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:01.163591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:01.175532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:01.180334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1163/2286] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:01.185543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:01.198973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28902a63-8aff-43e0-81f9-fbb4619debed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:01.209529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:01.210438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:01.210438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:01.210936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:01.212262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:01.214827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f0a6-bcc5-4508-800c-a43091c02705 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:01.231127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1124/2287] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:01.241319 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:01.262480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407db14e-2edd-4304-aad6-1c7409258d3c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:01.278376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:01.279103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:01.279407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:01.279822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] PATH_INFO: `/v3/projects/db5c00e7c79a44f48eb1ce01d6271318/users/a6e53f0aecfc40e199295b7752f0248c/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:01.297512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5c00e7c79a44f48eb1ce01d6271318, user_id=a6e53f0aecfc40e199295b7752f0248c, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:01.300264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:01.323895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:01.409831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1164/2288] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:39:01 2022] PUT /identity/v3/projects/db5c00e7c79a44f48eb1ce01d6271318/users/a6e53f0aecfc40e199295b7752f0248c/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:39:01.420233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092e75-c759-4c24-afba-7bf2c4c5657a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:01.420515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092e75-c759-4c24-afba-7bf2c4c5657a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:01.420819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092e75-c759-4c24-afba-7bf2c4c5657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:01.456491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-26092e75-c759-4c24-afba-7bf2c4c5657a None None] MFA Rules not processed for user `a6e53f0aecfc40e199295b7752f0248c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:01.458302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26092e75-c759-4c24-afba-7bf2c4c5657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:01.560997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1125/2289] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:01.574354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:01.576382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:01.670295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8628-9773-4d90-ae34-f6883a18b142 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:01.674409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:01.675024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:01.675310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:01.675803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:01.685271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:01.686860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:01.699311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1165/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:02.894279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=8,keystone:DELETE=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:02.950212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:02.950730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:02.950831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:02.970431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:02.971729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:02.986510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:03.029890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1126/2291] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:39:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:03.042547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:03.043988 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:03.115225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a7b7a-b68f-44be-860c-70e8ca351aa9 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:03.121457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:03.121943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:03.122224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:03.122495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:03.132801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:03.135005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:03.144700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1166/2292] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:03.888525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:04.029726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:04.539636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:04.648807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:04.794263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:05.202824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:05.425864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:05.491139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:05.768496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:05.968989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:07.014177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:07.534296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:07.900915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:08.035386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:08.056644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:08.104148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00377f5f-0342-45a7-acc4-f06955925b22 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:08.108923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:08.109614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.109899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.110178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] PATH_INFO: `/v3/users/a6e53f0aecfc40e199295b7752f0248c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.111386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e53f0aecfc40e199295b7752f0248c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:08.113363 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:08.242370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:08.244404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:08.257627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf1ba-9f08-453d-af07-7716f34cb468 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:08.263116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:08.263792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.264071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.264368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] PATH_INFO: `/v3/users/8f0d66339ede4c30907432e642d384b7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.265483 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0d66339ede4c30907432e642d384b7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:08.267424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:08.316978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e53f0aecfc40e199295b7752f0248c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.317770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e53f0aecfc40e199295b7752f0248c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.326241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e53f0aecfc40e199295b7752f0248c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.339664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e53f0aecfc40e199295b7752f0248c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.380022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:08.436752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7c85f3fb-88a3-45a3-884f-893751856e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e53f0aecfc40e199295b7752f0248c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.438279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:08.445977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1127/2293] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:39:08 2022] DELETE /identity/v3/users/a6e53f0aecfc40e199295b7752f0248c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:39:08.452342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.452710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.452967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.462305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0d66339ede4c30907432e642d384b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.477104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:08.478506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:08.484729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0d66339ede4c30907432e642d384b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.486270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0d66339ede4c30907432e642d384b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.500998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0d66339ede4c30907432e642d384b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.501926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ce4b6c6e-7e79-4f38-afe8-d9be391f2313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0d66339ede4c30907432e642d384b7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:08.558169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1128/2294] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:08.581070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:08.582748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:08.658317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38851-5e4f-4990-8c45-61f543f81a0c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:08.662217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:08.662878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.663167 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.663571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.677609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1167/2295] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:39:08 2022] DELETE /identity/v3/users/8f0d66339ede4c30907432e642d384b7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:08.683591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.704246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.704246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.704504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:08.704504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:08.704698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1129/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:08.706108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:08.707628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:08.804084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1168/2297] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:39:08.814223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:08.815785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:08.827297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b610d9-728a-4e73-a16d-f64636460b8a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:08.877271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:08.877873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:08.878150 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:08.878420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:08.887424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:08.888870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:08.901408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1130/2298] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:39:09.310864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:09.340165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:09.356187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:09.358466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:09.373176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf11692-c08d-40b7-b679-7de685bb5cea None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:09.378318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:09.379034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:09.379426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:09.379974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] PATH_INFO: `/v3/projects/db5c00e7c79a44f48eb1ce01d6271318` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:09.381431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5c00e7c79a44f48eb1ce01d6271318)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:09.384289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:09.552781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5c00e7c79a44f48eb1ce01d6271318', 'request_id': 'req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.557875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:09.559034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5c00e7c79a44f48eb1ce01d6271318', 'request_id': 'req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.561444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:09.576605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634505da-03e2-4043-8781-efb8e813cd07 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:09.625029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5c00e7c79a44f48eb1ce01d6271318', 'request_id': 'req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.638227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] The token cache is being invalidate because project db5c00e7c79a44f48eb1ce01d6271318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:39:09.638523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.639179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-2dda4b1d-672c-4d5a-9be1-4bf8dde54258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.640969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1169/2299] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:39:09 2022] DELETE /identity/v3/projects/db5c00e7c79a44f48eb1ce01d6271318 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:09.654594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:09.660790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:09.660790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:09.660790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] PATH_INFO: `/v3/projects/d99fb474085e448ead6bb902145fae99` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:09.660790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99fb474085e448ead6bb902145fae99)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:09.660790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:09.785981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99fb474085e448ead6bb902145fae99', 'request_id': 'req-62c57143-c755-4ff6-bf67-70a75c291d1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.792655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99fb474085e448ead6bb902145fae99', 'request_id': 'req-62c57143-c755-4ff6-bf67-70a75c291d1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.871665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99fb474085e448ead6bb902145fae99', 'request_id': 'req-62c57143-c755-4ff6-bf67-70a75c291d1b'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.888732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] The token cache is being invalidate because project d99fb474085e448ead6bb902145fae99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:39:09.889285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.890038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-62c57143-c755-4ff6-bf67-70a75c291d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:09.892274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1131/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:39:09 2022] DELETE /identity/v3/projects/d99fb474085e448ead6bb902145fae99 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:09.897304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:09.897832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:09.898143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:09.923847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:09.925333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:09.980263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:09.991859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1170/2301] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:09.996888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:10.000015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.003516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.003516 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.021908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:10.023207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:10.032564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1132/2302] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:10.046231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.057292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7193-2d5a-4692-aff1-b642a10d29b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.062926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.063770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.064128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.064492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.065248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:39:10.065626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.067342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.081631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1171/2303] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:39:10.085941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.107169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad69a-a2c7-48e4-9640-d6cfb306b8b2 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.113478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.114461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.115527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.116337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.118042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.121525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.204116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1133/2304] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:39:10 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:39:10.208235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.218655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753f76f-4096-4e5b-87b0-491985b465a5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.266961 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:10.293724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.294327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.294609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.294888 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.295560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.298156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.403692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1172/2305] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:39:10 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:39:10.408989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.431707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37565c5c-0d1d-48b7-a15a-b1a17159401b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.431707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527994-6520-4304-856c-5558fd175122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.431707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527994-6520-4304-856c-5558fd175122 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.431707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527994-6520-4304-856c-5558fd175122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.432354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61527994-6520-4304-856c-5558fd175122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.432354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527994-6520-4304-856c-5558fd175122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.432354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61527994-6520-4304-856c-5558fd175122 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.448614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.467270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc962d-31ce-4133-b2a3-155ef46ac754 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.467471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1134/2306] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:10.490851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.491511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.491806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.492139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.492754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.494763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d328-68f8-4a62-8448-5a4345ea94a7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.513829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527994-6520-4304-856c-5558fd175122 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.519797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1173/2307] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:10.544237 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61527994-6520-4304-856c-5558fd175122 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.550598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.551377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.551796 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.552175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] PATH_INFO: `/v3/projects/00366d95df574f68b173b4988d890c80/users/091efdd4e1214cc0877d80a27ee12def/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.587071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00366d95df574f68b173b4988d890c80, user_id=091efdd4e1214cc0877d80a27ee12def, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.591241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.678775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1135/2308] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:39:10 2022] PUT /identity/v3/projects/00366d95df574f68b173b4988d890c80/users/091efdd4e1214cc0877d80a27ee12def/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:10.689828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.690374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.690817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.706196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:10.726981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] MFA Rules not processed for user `091efdd4e1214cc0877d80a27ee12def`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:10.732457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:10.828213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1174/2309] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:10.841520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:10.843438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:10.929083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566d8b-bc86-4904-ad94-afa8c9ebfd9b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:10.935760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:10.936385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:10.936721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:10.936945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:10.946879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:10.948818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea55d8-90e9-4a83-ae2c-63e73b40b83f service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:10.957661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1136/2310] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:10.991167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:11.019922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:11.569059 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:11.636480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:12.533641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:12.841650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:12.916994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:13.265382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:13.568243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:13.705049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:13.808038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.214097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.265406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.533881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.591727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.722359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.779512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.836289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.904658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:14.996465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:15.093585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:15.155147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:15.179337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:15.226654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c12f4-6f58-44d6-afd7-95497bbb10ca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:15.231865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:15.232830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:15.233479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:15.233892 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] PATH_INFO: `/v3/users/091efdd4e1214cc0877d80a27ee12def` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:15.235454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=091efdd4e1214cc0877d80a27ee12def)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:15.238092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:15.457933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091efdd4e1214cc0877d80a27ee12def'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:15.465971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091efdd4e1214cc0877d80a27ee12def'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:15.466729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091efdd4e1214cc0877d80a27ee12def'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:15.485154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091efdd4e1214cc0877d80a27ee12def'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:15.489338 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091efdd4e1214cc0877d80a27ee12def'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:15.516580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:15.604118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1175/2311] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:39:15 2022] DELETE /identity/v3/users/091efdd4e1214cc0877d80a27ee12def => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:15.608792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:15.609833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:15.610306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:15.631503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:15.632778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:15.698611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1137/2312] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:15.709922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:15.712829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:15.782674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0a1e1-5c6b-4bd9-b09a-4506909195ae admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:15.786456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:15.787169 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:15.787540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:15.787881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:15.797872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:15.799348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00e5ec-dc0b-4ae3-8dc4-d95e28bbdcaa service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:15.809703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1176/2313] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:15.888263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:16.426273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:16.427792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:16.440259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7582f-d173-431b-a91a-ac0241d66dbc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:16.445428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:16.446221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:16.446610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:16.446857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] PATH_INFO: `/v3/projects/00366d95df574f68b173b4988d890c80` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:16.448135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00366d95df574f68b173b4988d890c80)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:16.451590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:16.580738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00366d95df574f68b173b4988d890c80', 'request_id': 'req-7f9fd975-16ff-4029-aab6-b4eca277bbb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:16.586623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00366d95df574f68b173b4988d890c80', 'request_id': 'req-7f9fd975-16ff-4029-aab6-b4eca277bbb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:16.681667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00366d95df574f68b173b4988d890c80', 'request_id': 'req-7f9fd975-16ff-4029-aab6-b4eca277bbb3'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:16.683934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:16.693490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] The token cache is being invalidate because project 00366d95df574f68b173b4988d890c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:39:16.693803 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:16.694444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:16.695958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1138/2314] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:39:16 2022] DELETE /identity/v3/projects/00366d95df574f68b173b4988d890c80 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:21.490596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2385b6-61ee-41c9-a170-a2e94e9bfa44 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:21.491942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2385b6-61ee-41c9-a170-a2e94e9bfa44 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:21.491942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2385b6-61ee-41c9-a170-a2e94e9bfa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:21.510690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ad2385b6-61ee-41c9-a170-a2e94e9bfa44 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:21.511922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ad2385b6-61ee-41c9-a170-a2e94e9bfa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:21.530548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:21.567984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1177/2315] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:21.580994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:21.582408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:21.652558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd975-16ff-4029-aab6-b4eca277bbb3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:21.658677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:21.659286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:21.659600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:21.659881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:21.669669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:21.671425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f55752-0b32-4fa2-bd58-8ab120254b33 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:21.679994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1139/2316] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:23.770027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a534-e605-44da-9074-cc20af8f994b None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:23.770799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a534-e605-44da-9074-cc20af8f994b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:23.770799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a534-e605-44da-9074-cc20af8f994b None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:23.772213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1178/2317] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:39:23.787035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ebc34-395a-45ac-b340-572b9f0a128e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:23.787712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ebc34-395a-45ac-b340-572b9f0a128e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:23.787712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ebc34-395a-45ac-b340-572b9f0a128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:23.816444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-538ebc34-395a-45ac-b340-572b9f0a128e None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:23.818193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-538ebc34-395a-45ac-b340-572b9f0a128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:23.973215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1140/2318] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:39:23.986150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a534-e605-44da-9074-cc20af8f994b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:23.988872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f673a534-e605-44da-9074-cc20af8f994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:24.069700 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a534-e605-44da-9074-cc20af8f994b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:24.073618 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:24.075222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.075522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.076074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.093967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:24.095579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52034eb-f607-4a59-ba7f-1d8f517d0170 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:24.128278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1179/2319] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:39:24.368086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.368502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.368882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] PATH_INFO: `/` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.370645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1141/2320] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:39:24.376757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafb7-ae1c-450c-8007-24cb8da250d8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.377440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafb7-ae1c-450c-8007-24cb8da250d8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.378174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeafb7-ae1c-450c-8007-24cb8da250d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.413715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7feeafb7-ae1c-450c-8007-24cb8da250d8 None None] MFA Rules not processed for user `1bef4155d39e4781b8b4e3cba14a5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:24.414902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7feeafb7-ae1c-450c-8007-24cb8da250d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:24.499642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1180/2321] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:39:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:24.517978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:24.517978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:24.591080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb902-6112-4752-9365-7e24e66ccb32 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:24.596023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:24.596720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.597077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.597483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.610632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:24.613495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd706df-0253-41a0-a8b2-836fc9f7947f service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:24.623726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1142/2322] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:24.756944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c812-52ed-4ed5-b960-7f603596719c None None] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.758320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c812-52ed-4ed5-b960-7f603596719c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.758829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c812-52ed-4ed5-b960-7f603596719c None None] PATH_INFO: `/` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.762001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1181/2323] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 16:39:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:39:24.768529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf980-5aa5-4942-8c89-bfabf38bb241 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.768764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf980-5aa5-4942-8c89-bfabf38bb241 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.769075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cf980-5aa5-4942-8c89-bfabf38bb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.805680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-234cf980-5aa5-4942-8c89-bfabf38bb241 None None] MFA Rules not processed for user `91692048695d4f96ad3ef501c8863b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:24.807318 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-234cf980-5aa5-4942-8c89-bfabf38bb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:24.824055 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1143/2324] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 16:39:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:39:24.835025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c812-52ed-4ed5-b960-7f603596719c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:24.847098 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c812-52ed-4ed5-b960-7f603596719c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:24.857551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:24.857551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:24.857551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:24.857551 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:24.863918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:24.865600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:24.876599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1182/2325] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:32.261212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:32.262330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:32.262330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:32.282424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:32.283731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:32.291152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1144/2326] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:32.303506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:32.320602 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ae82a-d272-4501-ae35-73b521dccf82 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:32.327062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:32.327777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:32.328147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:32.328584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:32.337619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:32.339222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eaeeb-603d-4fb6-8a09-73f725a87ba0 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:32.349315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1183/2327] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:39:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:33.562582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:33.576813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4311d7-62c9-4f60-8ac8-8f0baa3c4564 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:33.587063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:33.589399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:33.590944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:33.591454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:33.596943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:33.700206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:33.728546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:33.730261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:33.756067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1145/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:42.345202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=75 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:43.154554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:43.155175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:43.155682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:43.181973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:43.184822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:43.195153 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1184/2329] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:43.219835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:43.233177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9aea7-eb34-4ad6-b5dc-a0df0624ac75 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:43.239082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:43.240007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:43.240513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:43.241003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:43.255269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:43.257279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:43.267771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1146/2330] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:47.556645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:47.559342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:47.642773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccdd3e-7cd5-4e7a-8409-752917b4ccc2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:47.647861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:47.648707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:47.649139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:47.649568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] PATH_INFO: `/v3/users/99334ff226424a3ab1457e88ff21fe1a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:47.650863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99334ff226424a3ab1457e88ff21fe1a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:47.654088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:47.879013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99334ff226424a3ab1457e88ff21fe1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:47.887111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99334ff226424a3ab1457e88ff21fe1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:47.888197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99334ff226424a3ab1457e88ff21fe1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:47.902687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99334ff226424a3ab1457e88ff21fe1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:47.903432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99334ff226424a3ab1457e88ff21fe1a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:47.981715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1185/2331] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:39:47 2022] DELETE /identity/v3/users/99334ff226424a3ab1457e88ff21fe1a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:48.316567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:48.343957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fdd17-ddab-4b19-930d-a9fcb5ebafc3 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:48.418239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:48.419941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:48.466612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:48.467608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.469891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.470178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] PATH_INFO: `/v3/projects/cb8985d6e43f4ea29362eba1253c29c7` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.471791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8985d6e43f4ea29362eba1253c29c7)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:48.474131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:48.516242 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a5a6-146c-41c9-819a-aa5b68864fc1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:48.521944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:48.523417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.523751 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.524038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.526577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:48.541942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:48.543670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4fce4-4bb1-4ecb-95a6-b71141ff7545 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:48.556585 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1186/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:48.627856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8985d6e43f4ea29362eba1253c29c7', 'request_id': 'req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:48.633942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8985d6e43f4ea29362eba1253c29c7', 'request_id': 'req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:48.726499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8985d6e43f4ea29362eba1253c29c7', 'request_id': 'req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:48.741864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] The token cache is being invalidate because project cb8985d6e43f4ea29362eba1253c29c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:39:48.742275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:48.743005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-57a1ef73-c7b0-4d9c-a5d5-4874cbd3a472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:39:48.745026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1147/2333] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:39:48 2022] DELETE /identity/v3/projects/cb8985d6e43f4ea29362eba1253c29c7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:48.750310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.754524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.754524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.760671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:48.777243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:48.779048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:48.865028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1187/2334] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:48.873711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29aa60-4352-4f84-9594-dc305770face None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.874001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29aa60-4352-4f84-9594-dc305770face None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.874283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29aa60-4352-4f84-9594-dc305770face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.908017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0c29aa60-4352-4f84-9594-dc305770face None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:48.909445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0c29aa60-4352-4f84-9594-dc305770face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:48.923012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1148/2335] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:48.924250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:48.935954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9216-d858-4a0d-a111-fe9435b30ba9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:48.941260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:48.943365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.943365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.943365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.943917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:39:48.944419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:48.946239 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:48.965351 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1188/2336] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:39:48.969687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29aa60-4352-4f84-9594-dc305770face None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:48.983428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29aa60-4352-4f84-9594-dc305770face None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:48.990910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:48.991602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:48.992080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:48.992360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:48.993011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:48.996421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:49.091186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1149/2337] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:39:48 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:39:49.095847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:49.117986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b003-e5cc-49a6-8fd0-03fb9197fe92 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:49.222628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:49.223341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.223562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.223826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:49.224528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:49.229052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:49.521620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1189/2338] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:39:49 2022] POST /identity/v3/users => generated 288 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:39:49.525979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:49.539220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce2fa-914e-4b19-a8c0-9b0d5915e9b6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:49.550243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:49.557108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.557108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.557108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:49.557108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:49.557108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:49.577573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1150/2339] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:49.581445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:49.593877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a478fa-16f1-463d-a5f2-ffc7a282f31b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:49.599436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:49.600167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.600598 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.601520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:49.601873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:49.603686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d445f2-515a-4358-bf34-6eabc644e5ec admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:49.616358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1190/2340] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:39:49.621179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:49.632777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387ef1-f50b-4732-a6fa-850399340869 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:49.638471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:49.639502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.639637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.641972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] PATH_INFO: `/v3/projects/b9086dfb58a840ee8c819627bbd6b22e/users/42013eb4da664e49bf9164a574d33fb1/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:49.672242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9086dfb58a840ee8c819627bbd6b22e, user_id=42013eb4da664e49bf9164a574d33fb1, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:49.672242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:49.744812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:49.752766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1151/2341] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:39:49 2022] PUT /identity/v3/projects/b9086dfb58a840ee8c819627bbd6b22e/users/42013eb4da664e49bf9164a574d33fb1/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:39:49.762901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f39c72-2085-4520-8d95-c82216dda2b7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.763420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f39c72-2085-4520-8d95-c82216dda2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.763563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f39c72-2085-4520-8d95-c82216dda2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:49.794180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-88f39c72-2085-4520-8d95-c82216dda2b7 None None] MFA Rules not processed for user `42013eb4da664e49bf9164a574d33fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:49.795222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-88f39c72-2085-4520-8d95-c82216dda2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:49.892314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:49.900941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1191/2342] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:49.916035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:49.919234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:49.988918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab40b-39cd-48e6-9337-fd60ed524440 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:49.995075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:49.995782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:49.996089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:49.996386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:50.006321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:50.007817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe249b-7a60-4d3d-97cd-a573f13cb5ca service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:50.019060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1152/2343] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:39:51.840959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:51.841468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:51.841681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:51.861881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] MFA Rules not processed for user `42013eb4da664e49bf9164a574d33fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:51.863062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:51.874110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1192/2344] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:53.773627 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79623f63-e68a-4f86-9844-0ac759c96e41 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:53.774111 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79623f63-e68a-4f86-9844-0ac759c96e41 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:53.774211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79623f63-e68a-4f86-9844-0ac759c96e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:53.793921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-79623f63-e68a-4f86-9844-0ac759c96e41 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:39:53.795112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-79623f63-e68a-4f86-9844-0ac759c96e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:53.850072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1153/2345] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:39:53.862547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:39:53.863975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:39:53.932481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8471-6b76-48ca-b843-b408d2577839 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:39:53.938182 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:39:53.938785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:39:53.939071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:39:53.939347 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:39:53.947334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:39:53.949641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d7639-ce22-484a-a9cd-6b2848e0b5a2 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:39:53.957601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1193/2346] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:03.842611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=52 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:03.954454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=36 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:04.688268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:04.688557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:04.688835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:04.708674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] MFA Rules not processed for user `a0a1588ce02044c183ea0e2fea20e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:04.709883 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:04.766216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1154/2347] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:14.758714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=25 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:16.557069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26c77-2293-4510-884b-17bc98d17b6d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:16.557619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26c77-2293-4510-884b-17bc98d17b6d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:16.557619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb26c77-2293-4510-884b-17bc98d17b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:16.577533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2cb26c77-2293-4510-884b-17bc98d17b6d None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:16.578791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2cb26c77-2293-4510-884b-17bc98d17b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:16.586127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1194/2348] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:16.600690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:16.612823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8eae42-f7fc-4830-8d38-ab977c5d7be5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:16.618860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:16.619471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:16.619782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:16.620052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:16.629852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:16.631444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:16.640920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1155/2349] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:17.578649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a505d-eb4d-48d8-84c7-9db15fdf963c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:17.579157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a505d-eb4d-48d8-84c7-9db15fdf963c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:17.582055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a505d-eb4d-48d8-84c7-9db15fdf963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:17.599912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-832a505d-eb4d-48d8-84c7-9db15fdf963c None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:17.601107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-832a505d-eb4d-48d8-84c7-9db15fdf963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:17.608938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1195/2350] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:17.621045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:17.631528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f42b-e73c-4e63-99e5-0bb515d8ca1c service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:17.636718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:17.637824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:17.638103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:17.638374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:17.646939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:17.651864 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:17.657954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1156/2351] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:40:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:18.262746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b8a6a-652f-4cad-a7c0-b303de2a6305 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:18.263057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b8a6a-652f-4cad-a7c0-b303de2a6305 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:18.263356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b8a6a-652f-4cad-a7c0-b303de2a6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:18.287756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9a7b8a6a-652f-4cad-a7c0-b303de2a6305 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:18.288966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9a7b8a6a-652f-4cad-a7c0-b303de2a6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:18.297305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1196/2352] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:18.309685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:18.320827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe8f3-bb0d-4482-a6be-1d1c669781f4 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:18.326937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:18.327586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:18.328071 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:18.328352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:18.337644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:18.340917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:18.348205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1157/2353] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:18.972806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:18.973348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:18.973348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:18.994900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:18.996170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:19.005001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1197/2354] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:19.018473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:19.029997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ed9a-b67f-4f4d-a2a3-2d7bcde277c3 service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:19.035600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:19.036215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:19.036503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:19.036789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:19.045983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:19.047606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4d9f-9f0c-46d4-8a0c-790b9e7a212c service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:19.056442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1158/2355] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:22.051876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:22.123146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ca067-550c-4ddb-a4da-42500cafe7b3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:22.127813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:22.128465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:22.128775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:22.129052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] PATH_INFO: `/v3/users/42013eb4da664e49bf9164a574d33fb1` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:22.130205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42013eb4da664e49bf9164a574d33fb1)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:22.132206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:22.351764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42013eb4da664e49bf9164a574d33fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:22.363316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42013eb4da664e49bf9164a574d33fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:22.364117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42013eb4da664e49bf9164a574d33fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:22.378607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42013eb4da664e49bf9164a574d33fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:22.379342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42013eb4da664e49bf9164a574d33fb1'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:22.491576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1198/2356] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:40:22 2022] DELETE /identity/v3/users/42013eb4da664e49bf9164a574d33fb1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:40:22.496706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:22.497098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:22.497359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:22.524697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:22.529405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:22.613822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1159/2357] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:22.624561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:22.626084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:22.692407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8d784-00b3-403d-b06c-9bbc6b961d51 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:22.697160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:22.697461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:22.697770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:22.698028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:22.707439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:22.710200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:22.711697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d0c6-d851-4549-b9bf-2614173d7d0c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:22.724370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1199/2358] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:40:23.210814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:23.212489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:23.225475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776e77c-826a-4b78-ac5f-32b8dab9ba5e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:23.230246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:23.234416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.234416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.234416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] PATH_INFO: `/v3/projects/b9086dfb58a840ee8c819627bbd6b22e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.234416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9086dfb58a840ee8c819627bbd6b22e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:23.235286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:23.367107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9086dfb58a840ee8c819627bbd6b22e', 'request_id': 'req-94c64be0-00d5-4dd0-8cde-04d39dffeebd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:23.373303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9086dfb58a840ee8c819627bbd6b22e', 'request_id': 'req-94c64be0-00d5-4dd0-8cde-04d39dffeebd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:23.440089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9086dfb58a840ee8c819627bbd6b22e', 'request_id': 'req-94c64be0-00d5-4dd0-8cde-04d39dffeebd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:23.452808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] The token cache is being invalidate because project b9086dfb58a840ee8c819627bbd6b22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:40:23.453220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:23.453905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-94c64be0-00d5-4dd0-8cde-04d39dffeebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:40:23.455588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1160/2359] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:40:23 2022] DELETE /identity/v3/projects/b9086dfb58a840ee8c819627bbd6b22e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:40:23.460617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.461083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.461184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.481694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:23.483000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:23.543379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1200/2360] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:23.612216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.612775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.613023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.635509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:23.637372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:23.647574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1161/2361] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:23.653006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:23.663783 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb1ba-afab-48df-b1ea-ce34b0dc06f2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:23.669534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:23.671063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.671502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.671885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.672671 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:40:23.673042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:23.674749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:23.690013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1201/2362] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:40:23.694455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:23.705143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113d9d-d228-4265-b2d0-76639d0565fc None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:23.710405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:23.711823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.711823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.712183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.712957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:23.715094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:23.801220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1162/2363] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:40:23 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:40:23.803061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:23.815033 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c8565-59e6-44c2-9435-3018d4694e1c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:23.906164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:23.907126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:23.907657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:23.908129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:23.908981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:23.911221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:24.009052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1202/2364] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:40:23 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:40:24.017222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:24.022831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:24.028988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fccf4-86f2-4e47-9db9-b5b964fb1648 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:24.033998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:24.034766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:24.035059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:24.035337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:24.036038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:24.037663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:24.051214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1163/2365] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:40:24.052457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:24.063346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d6df-c13f-49bd-9e78-3e70710fca53 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:24.069660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:24.070276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:24.070559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:24.077624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:24.077624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:24.077624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2441e0-61c2-4158-a91e-18e0c90cc65e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:24.086938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1203/2366] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:40:24.090912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:24.101859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359134-2891-46ab-9960-d64823f596d7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:24.107823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:24.108760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:24.109252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:24.110283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] PATH_INFO: `/v3/projects/c721e27f3cde4f7aafc564f25e9579d5/users/9b4327333bda4d19a686a1f42a764ccd/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:24.125233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c721e27f3cde4f7aafc564f25e9579d5, user_id=9b4327333bda4d19a686a1f42a764ccd, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:24.128091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:24.213718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1164/2367] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:40:24 2022] PUT /identity/v3/projects/c721e27f3cde4f7aafc564f25e9579d5/users/9b4327333bda4d19a686a1f42a764ccd/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:40:24.220894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc4c-3429-4439-8d79-ec07e9aa9d1e None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:24.220894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc4c-3429-4439-8d79-ec07e9aa9d1e None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:24.220894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81bc4c-3429-4439-8d79-ec07e9aa9d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:24.239344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7a81bc4c-3429-4439-8d79-ec07e9aa9d1e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:24.240529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7a81bc4c-3429-4439-8d79-ec07e9aa9d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:24.323434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1204/2368] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:24.330845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:24.332790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:24.397201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237711-f022-4a8c-91e7-91bc1559d565 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:24.401115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:24.401734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:24.402017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:24.402296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:24.413040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:24.414481 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:24.426162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1165/2369] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:40:26.068944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c15b-620b-44bd-8b8b-f7c5e3a87ba2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:26.069472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c15b-620b-44bd-8b8b-f7c5e3a87ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:26.069564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c15b-620b-44bd-8b8b-f7c5e3a87ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:26.077386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:26.099826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cd01c15b-620b-44bd-8b8b-f7c5e3a87ba2 None None] MFA Rules not processed for user `9b4327333bda4d19a686a1f42a764ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:26.101089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd01c15b-620b-44bd-8b8b-f7c5e3a87ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:26.173669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1205/2370] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:26.184570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:40:26.185981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:26.243908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72e140-727d-4ccd-a238-133741528cc5 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:40:26.247456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:40:26.248092 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:26.248375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:26.248652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:26.257046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:40:26.258468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4f75-89bb-4250-9020-0d77c1d18968 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:40:26.270750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1166/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:40:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:40:27.977513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea137-d18d-48da-a1ab-56d9ac34a04d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:27.977992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea137-d18d-48da-a1ab-56d9ac34a04d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:27.978100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea137-d18d-48da-a1ab-56d9ac34a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:27.997872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-956ea137-d18d-48da-a1ab-56d9ac34a04d None None] MFA Rules not processed for user `9b4327333bda4d19a686a1f42a764ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:27.999072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-956ea137-d18d-48da-a1ab-56d9ac34a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:28.005952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1206/2372] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:40:36.263656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:37.992566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=34 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:42.381664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944343d-09b7-4942-802b-ce1b3d7dcfef None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:42.382116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944343d-09b7-4942-802b-ce1b3d7dcfef None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:42.382225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944343d-09b7-4942-802b-ce1b3d7dcfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:42.401569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0944343d-09b7-4942-802b-ce1b3d7dcfef None None] MFA Rules not processed for user `e2d6c76ba6c34f219faf59f9dd1b1fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:42.403766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0944343d-09b7-4942-802b-ce1b3d7dcfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:42.457900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1167/2373] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:40:52.451302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=25 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:55.945702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:40:55.946423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:40:55.946423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:40:55.970733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] MFA Rules not processed for user `c6ed88668fa04f3f8b423af40e240557`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:40:55.972125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:40:56.038596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1207/2374] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:06.025151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=25 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:06.328207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac534-7658-487b-b497-63237e7243e4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:06.328831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac534-7658-487b-b497-63237e7243e4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:06.328831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac534-7658-487b-b497-63237e7243e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:06.349891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-609ac534-7658-487b-b497-63237e7243e4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:06.351889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-609ac534-7658-487b-b497-63237e7243e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:06.359533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1168/2375] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:06.389171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:06.390541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:06.466456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e18d7-55f7-462a-a8f8-5a235944821d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:06.472186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:06.472820 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:06.473101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:06.473374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:06.481422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:06.482998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:06.492905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1208/2376] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:11.670977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632cab-11ff-45e2-8cd7-43e194a7a0c9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:11.671584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632cab-11ff-45e2-8cd7-43e194a7a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:11.671584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632cab-11ff-45e2-8cd7-43e194a7a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:11.693995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7c632cab-11ff-45e2-8cd7-43e194a7a0c9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:11.695415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7c632cab-11ff-45e2-8cd7-43e194a7a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:11.704050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1169/2377] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:11.736480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:11.748831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55cea-e809-4cfd-b295-760c41f695e0 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:11.754648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:11.755253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:11.755567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:11.755842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:11.764978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:11.766579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:11.778113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1209/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:17.164189 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462579f-7755-48fb-8e90-c466f793d3fe None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:17.164678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462579f-7755-48fb-8e90-c466f793d3fe None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:17.164792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462579f-7755-48fb-8e90-c466f793d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:17.185528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-5462579f-7755-48fb-8e90-c466f793d3fe None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:17.186816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5462579f-7755-48fb-8e90-c466f793d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:17.195833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1170/2379] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:17.218160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:17.230139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99e03c-d435-4f7c-89fc-1ac92cb99f39 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:17.235793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:17.237681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:17.238095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:17.238436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:17.247363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:17.248990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:17.260275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1210/2380] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:21.192454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfdf55-672a-48ab-9d36-41ff157e626e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:21.192943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfdf55-672a-48ab-9d36-41ff157e626e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:21.193036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfdf55-672a-48ab-9d36-41ff157e626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:21.213724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dabfdf55-672a-48ab-9d36-41ff157e626e None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:21.214953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dabfdf55-672a-48ab-9d36-41ff157e626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:21.223857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1171/2381] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:21.245264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:21.257005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64db23-8c5f-4a9c-a661-55b6c2494e56 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:21.262463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:21.263046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:21.263324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:21.263635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:21.272429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:21.273991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:21.283570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1211/2382] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:28.503601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca3f9-8531-4db2-8d49-1b54ad14d9a3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:28.504308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca3f9-8531-4db2-8d49-1b54ad14d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:28.504308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca3f9-8531-4db2-8d49-1b54ad14d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:28.524547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dd2ca3f9-8531-4db2-8d49-1b54ad14d9a3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:28.525694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dd2ca3f9-8531-4db2-8d49-1b54ad14d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:28.534890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1172/2383] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:28.798211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:28.798211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:28.813843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d4049-fa59-48f4-85a9-8fbfb6a5c541 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:28.820748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:28.821350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:28.821627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:28.821899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:28.830566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:28.832293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:28.842296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1212/2384] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:32.252598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830193-8294-4857-9eea-f4f9815d023f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:32.256423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830193-8294-4857-9eea-f4f9815d023f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:32.256423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830193-8294-4857-9eea-f4f9815d023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:32.273353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-8c830193-8294-4857-9eea-f4f9815d023f None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:32.274539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c830193-8294-4857-9eea-f4f9815d023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:32.328949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1173/2385] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:32.506064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:32.507678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:32.583983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ffcb-ddd3-43d0-96aa-48347a94bef7 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:32.589047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:32.589656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:32.589957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:32.590231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:32.600117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:32.601720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:32.609877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1213/2386] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:41:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:41:32.761979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:32.762292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:32.762575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:32.771217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=41 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:32.783357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:32.785843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:32.793870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1174/2387] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:32.821487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:32.834068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f6b91-d12f-4a49-aaf4-68befffe3b25 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:32.839453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:32.840349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:32.840349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:32.840597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:32.849377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:32.850960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1b9d6-e60d-4ec3-844f-7c7e58c8c291 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:32.860419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1214/2388] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:36.898245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:36.908348 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14e6b-5682-4d94-b814-ff25894eaea5 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:36.912813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:36.913497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:36.913846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:36.914538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:36.916411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:36.930200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:36.931674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:36.954972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1175/2389] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:37.665732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:37.666769 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:37.667144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:37.674669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:37.688861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] MFA Rules not processed for user `a0a1588ce02044c183ea0e2fea20e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:37.690296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:37.749275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1215/2390] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:37.878500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:37.888271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f2b9e-959f-4f8f-86e9-8517adbc76b0 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:37.892102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:37.892709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:37.892989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:37.893416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:37.896065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:37.911386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:37.913608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:37.925996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1176/2391] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:42.051335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:42.051335 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:42.062241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dcbb2-624a-4195-ab75-15db922ea56d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:42.067377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:42.068064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:42.068343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:42.068619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] PATH_INFO: `/v3/users/dc296a7422714a068b3abb84b1749434` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:42.069768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc296a7422714a068b3abb84b1749434)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:42.071779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:42.090462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:42.102532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c651ad-5002-48db-9422-bbf438e99148 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:42.107972 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:42.113988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:42.113988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:42.113988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:42.113988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:42.121674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:42.123229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:42.131958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1177/2392] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:41:42.309458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc296a7422714a068b3abb84b1749434'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.316260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc296a7422714a068b3abb84b1749434'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.316917 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc296a7422714a068b3abb84b1749434'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.329028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc296a7422714a068b3abb84b1749434'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.329684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc296a7422714a068b3abb84b1749434'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.431806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1216/2393] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:41:42 2022] DELETE /identity/v3/users/dc296a7422714a068b3abb84b1749434 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:41:42.725992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:42.737279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4b1e2-d6a0-43ad-8e3e-9f7778173872 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:42.797176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:42.797812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:42.798121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:42.798396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] PATH_INFO: `/v3/projects/9146f31d2f1e4b3e9fd32e42654e902e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:42.799724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9146f31d2f1e4b3e9fd32e42654e902e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:42.801842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:42.914183 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9146f31d2f1e4b3e9fd32e42654e902e', 'request_id': 'req-ef533f8f-6b92-4df2-b3e2-a4c619219375'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:42.919735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9146f31d2f1e4b3e9fd32e42654e902e', 'request_id': 'req-ef533f8f-6b92-4df2-b3e2-a4c619219375'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.027311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9146f31d2f1e4b3e9fd32e42654e902e', 'request_id': 'req-ef533f8f-6b92-4df2-b3e2-a4c619219375'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.046583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] The token cache is being invalidate because project 9146f31d2f1e4b3e9fd32e42654e902e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:41:43.046871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.047515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.053380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1178/2394] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:41:42 2022] DELETE /identity/v3/projects/9146f31d2f1e4b3e9fd32e42654e902e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:41:43.057382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:43.058947 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:43.073519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed42d-9a34-4202-86ec-91c10f7d1223 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:43.130717 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:43.131381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:43.131702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:43.131979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] PATH_INFO: `/v3/users/aec43d700da048ab986b4f789b740e77` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:43.133172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec43d700da048ab986b4f789b740e77)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:43.135130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:43.160713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:43.370789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec43d700da048ab986b4f789b740e77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.377660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec43d700da048ab986b4f789b740e77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.378388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec43d700da048ab986b4f789b740e77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.390459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec43d700da048ab986b4f789b740e77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.391114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec43d700da048ab986b4f789b740e77'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.487614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1217/2395] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:41:43 2022] DELETE /identity/v3/users/aec43d700da048ab986b4f789b740e77 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:41:43.752554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:43.754777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:43.769971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef533f8f-6b92-4df2-b3e2-a4c619219375 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:43.833074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:43.846749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:43.847514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:43.847794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:43.848091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] PATH_INFO: `/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:43.849223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae93f572c2a4eab8e1f0656ac05ca84)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:43.851532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:43.963107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae93f572c2a4eab8e1f0656ac05ca84', 'request_id': 'req-952036df-9064-45ee-8e42-92ce7847197f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:43.969324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae93f572c2a4eab8e1f0656ac05ca84', 'request_id': 'req-952036df-9064-45ee-8e42-92ce7847197f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:44.059412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae93f572c2a4eab8e1f0656ac05ca84', 'request_id': 'req-952036df-9064-45ee-8e42-92ce7847197f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:44.071264 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] The token cache is being invalidate because project 2ae93f572c2a4eab8e1f0656ac05ca84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:41:44.071595 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:44.072232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-952036df-9064-45ee-8e42-92ce7847197f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:41:44.075241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1179/2396] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:41:43 2022] DELETE /identity/v3/projects/2ae93f572c2a4eab8e1f0656ac05ca84 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:41:53.483859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:53.713445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:53.715008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:53.792584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd314-0457-4da4-8d84-52ccfa0b066e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:53.858294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:53.858918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:53.859204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:53.859498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:53.861349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:53.926812 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:53.928504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:53.937805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1218/2397] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:54.139697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:56.139014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:56.139668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:56.139809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:56.163145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] MFA Rules not processed for user `9b4327333bda4d19a686a1f42a764ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:41:56.164555 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:56.223102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1180/2398] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:41:56.538876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:56.540524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:56.581267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:56.598738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251274-32bb-4d04-aed1-b328fbf88b10 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:56.603697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:56.603697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:56.603697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:56.603697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:56.605416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:56.616352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:56.617632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:56.626652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1219/2399] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:57.328329 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:57.330776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:57.418015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5362d13-1181-4614-be1a-46e0efb3dee9 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:57.423681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:57.424830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:57.425344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:57.425783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:57.428034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:57.447506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:57.450410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:57.473942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1181/2400] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:41:58.878359 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:41:58.879948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:58.907517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1f03-7aae-4254-81d7-24c73e5edeb0 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:41:58.916431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:41:58.917050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:41:58.917328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:41:58.917594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:41:58.919636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:41:58.985686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:41:58.987449 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:41:58.997866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1220/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:07.223132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:07.225423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:07.233145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94573a-6e54-4cc8-80c4-4b9d94d53893 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:07.234977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544a6b-94f2-4cb9-99fa-12ece5a6077c service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:07.239334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:07.242460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:07.242460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:07.242460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:07.243016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:07.243605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:07.244294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:07.244651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:07.245010 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:07.246782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:07.254123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:07.255654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1343-b924-44c5-a695-ae3d4990dd83 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:07.258805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:07.260490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:07.264761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1221/2402] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:42:07.270274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1182/2403] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:07.367851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:07.368148 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:07.368575 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:07.390140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] MFA Rules not processed for user `01e09dde19114205bc3a73aab9e8cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:07.391579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:07.462874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1222/2404] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:09.635027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:09.636487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:09.647536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f29-c8cc-4fcf-b131-9c4da6bcf8b5 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:09.651631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:09.652120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:09.652404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:09.652683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:09.654494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:09.726300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:09.727792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:09.738523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1183/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:14.172938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:14.191423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ffe01-1037-48e6-a6c5-f570ee3b5c8c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:14.197377 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:14.197987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:14.198269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:14.198538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:14.200334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:14.214040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:14.215996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:14.226446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1223/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:14.347942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:14.349856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:14.364061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ae9ef-c054-49e0-9e50-53b4640ffe7b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:14.369000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:14.369708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:14.369993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:14.371742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] PATH_INFO: `/v3/users/e2d6c76ba6c34f219faf59f9dd1b1fea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:14.371742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d6c76ba6c34f219faf59f9dd1b1fea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:14.373584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:14.388164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:14.608501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d6c76ba6c34f219faf59f9dd1b1fea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:14.609271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d6c76ba6c34f219faf59f9dd1b1fea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:14.618610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d6c76ba6c34f219faf59f9dd1b1fea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:14.632116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d6c76ba6c34f219faf59f9dd1b1fea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:14.689920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d6c76ba6c34f219faf59f9dd1b1fea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:14.697423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1184/2407] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:14 2022] DELETE /identity/v3/users/e2d6c76ba6c34f219faf59f9dd1b1fea => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:14.865661 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:14.867200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:14.883046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0a68-38ff-4785-af41-6c49316fd9a9 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:14.933731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:14.947684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:14.948325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:14.948604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:14.948903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:14.950736 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:14.956960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:14.958713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:14.968004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:14.968004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ba05c-37fe-484f-aa07-1e59f4f5040b service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:14.979640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1224/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:15.036503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993fb1-1a97-4e24-8a31-5c76be8fd8c2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.041089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.041720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.041997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.044830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] PATH_INFO: `/v3/projects/d5edb9fb13b44b7291d85d3b076bae67` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.044830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5edb9fb13b44b7291d85d3b076bae67)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.045316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.187611 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5edb9fb13b44b7291d85d3b076bae67', 'request_id': 'req-9aba1386-6fa7-4d84-a524-91f13e3a2652'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:15.196122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5edb9fb13b44b7291d85d3b076bae67', 'request_id': 'req-9aba1386-6fa7-4d84-a524-91f13e3a2652'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:15.270515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5edb9fb13b44b7291d85d3b076bae67', 'request_id': 'req-9aba1386-6fa7-4d84-a524-91f13e3a2652'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:15.282678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] The token cache is being invalidate because project d5edb9fb13b44b7291d85d3b076bae67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:15.282973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:15.283649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9aba1386-6fa7-4d84-a524-91f13e3a2652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:15.286346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1185/2409] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:14 2022] DELETE /identity/v3/projects/d5edb9fb13b44b7291d85d3b076bae67 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:42:15.291176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.292060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.292495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.312642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:15.313914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:15.389278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1225/2410] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:15.391922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.392425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.392628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.415758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:15.416923 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:15.425178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1186/2411] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:15.429586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.439763 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881a479-b240-476d-93d1-f8fb15c89dc5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.445254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.445887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.446175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.448017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.448568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:42:15.448890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.450645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.464523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1226/2412] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:42:15.469313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.480324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3878-5748-4a73-97aa-139f40624d23 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.485309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.486199 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.486490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.486769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.487437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.489565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.500025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:15.580450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1187/2413] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:15 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:42:15.585297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.596090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d5b7-33a8-4fe0-9703-d457e1780e7e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.666268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.666825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.667108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.667384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.668112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.672475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.779337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1227/2414] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:15 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:15.783476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.794002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b93c-baa6-4639-a00f-d6876f1984c4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.798527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.799200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.799581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.799952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.805128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.805128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.817597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1188/2415] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:15.818787 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.828851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f54f0e-7483-4ed1-b360-6d0239325182 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.834170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.834774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.835058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.835330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.836002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.837601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f333b7-433c-4ee8-b1c0-4ca0567c6d5a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.851573 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1228/2416] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:42:15.852708 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:15.862585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965fa1-1356-40ff-982e-1cf0ce4d05f3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:15.867015 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:15.867710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.868027 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.868267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] PATH_INFO: `/v3/projects/12ee593631bb4b209672706c435ddc5f/users/16f8131a69564b6b97fd56e8865bc05c/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:15.882908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ee593631bb4b209672706c435ddc5f, user_id=16f8131a69564b6b97fd56e8865bc05c, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:15.885658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:15.972822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1189/2417] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:15 2022] PUT /identity/v3/projects/12ee593631bb4b209672706c435ddc5f/users/16f8131a69564b6b97fd56e8865bc05c/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:42:15.982712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:15.983000 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:15.983280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:16.011861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] MFA Rules not processed for user `16f8131a69564b6b97fd56e8865bc05c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:16.013078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:16.046953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:16.078501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1229/2418] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:16.090128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:16.091930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:16.164212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c76c-e6a6-4fde-a45b-704862c0c09c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:16.169699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:16.170303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:16.170581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:16.170854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:16.178975 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:16.180593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24176ef2-9e83-4ac1-a05d-7ef09f331c1d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:16.189509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1190/2419] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:16.436113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:16.505743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524d1e6-1f75-419d-9176-2aa9dae67c9d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:16.510918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:16.511591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:16.511880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:16.512168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] PATH_INFO: `/v3/users/16f8131a69564b6b97fd56e8865bc05c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:16.513288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f8131a69564b6b97fd56e8865bc05c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:16.515223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:16.720498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f8131a69564b6b97fd56e8865bc05c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:16.736867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f8131a69564b6b97fd56e8865bc05c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:16.746042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f8131a69564b6b97fd56e8865bc05c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:16.782532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f8131a69564b6b97fd56e8865bc05c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:16.783283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f8131a69564b6b97fd56e8865bc05c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:16.924504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1230/2420] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:16 2022] DELETE /identity/v3/users/16f8131a69564b6b97fd56e8865bc05c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:16.929422 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:16.929905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:16.930026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:16.951243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:16.952504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:17.014431 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1191/2421] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:17.026580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:17.028738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:17.096862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e05e49-9ea0-4101-a175-3b2983771087 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:17.100768 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:17.101441 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.101720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.101997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.111270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:17.113397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f5bd-8cf3-4b99-808c-bc8c4f04fd08 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:17.117582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:17.124024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1231/2422] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:17.522675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:17.524129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:17.537068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6d16-5a21-467d-9d18-0e737f60e3bd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:17.541607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:17.542243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.542520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.542794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] PATH_INFO: `/v3/projects/12ee593631bb4b209672706c435ddc5f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.548228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ee593631bb4b209672706c435ddc5f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:17.548228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:17.647068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:17.656635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ee593631bb4b209672706c435ddc5f', 'request_id': 'req-37a3c039-3291-487f-b834-83b023e69e82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:17.662770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ee593631bb4b209672706c435ddc5f', 'request_id': 'req-37a3c039-3291-487f-b834-83b023e69e82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:17.729371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ee593631bb4b209672706c435ddc5f', 'request_id': 'req-37a3c039-3291-487f-b834-83b023e69e82'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:17.742727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] The token cache is being invalidate because project 12ee593631bb4b209672706c435ddc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:17.743262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:17.743979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-37a3c039-3291-487f-b834-83b023e69e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:17.745462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1192/2423] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:17 2022] DELETE /identity/v3/projects/12ee593631bb4b209672706c435ddc5f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:17.750638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.751138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.751252 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.771510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:17.772789 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:17.832548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1232/2424] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:17.841531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.841946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.842228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.862062 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:17.863415 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:17.871105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1193/2425] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:42:17.875500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:17.885123 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfc133-7ebc-457b-983b-e75256b14723 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:17.889673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:17.890269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.890552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.890860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.891525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:42:17.891836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:17.893953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:17.906219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1233/2426] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:42:17.911080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:17.920419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ee31-8202-45d1-891a-e2e4ba912516 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:17.925014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:17.925610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:17.925902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:17.926173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:17.926815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:17.928722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.036621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1194/2427] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:17 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:18.037650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.047795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76cf9d-9196-43cd-ae18-3f2ed53c06f1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.115600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.116155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.116439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.116817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.117454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.119383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.225334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1234/2428] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:18 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:18.229291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.240118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2412be-457a-4344-aa51-99854281318b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.244933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.245552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.246000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.246277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.246927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.250085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.264731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1195/2429] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:42:18.266026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.279870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abe1e0-a149-4c08-bbd2-9dbc0d94a9a1 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.284909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.285652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.285943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.286218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.286887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.288608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062fa4d-3016-4ac7-9b23-e08832c27e11 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.301366 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1235/2430] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:18.305102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.315137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049ef8-dc88-4781-a93d-25782123d75e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.320589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.324137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.324137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.324137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] PATH_INFO: `/v3/projects/1683a302ebc347a9bcc92d58b6f693a6/users/7561f9d0c6964711a352bcc73c3e26d8/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.338005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1683a302ebc347a9bcc92d58b6f693a6, user_id=7561f9d0c6964711a352bcc73c3e26d8, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.340740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.435847 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1196/2431] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:18 2022] PUT /identity/v3/projects/1683a302ebc347a9bcc92d58b6f693a6/users/7561f9d0c6964711a352bcc73c3e26d8/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:18.447726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.448121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.448399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.476293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] MFA Rules not processed for user `7561f9d0c6964711a352bcc73c3e26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:18.477525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:18.532349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:18.542703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1236/2432] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:18.547233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.608658 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cc9cd-73c0-4ce4-968d-a60abc1f62ed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.613790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.614385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.614669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.614939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.615596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.617521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.719821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1197/2433] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:18 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:18.724774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.735508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e64b7a-558b-4977-b9cc-370e2258b3f8 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.794786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.795472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.795747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.795977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.796608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.798584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.901863 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1237/2434] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:18 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:18.906165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.918728 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2e95-cc0d-4560-ab2f-d2a51fadb156 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.923950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.924629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.924911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.925544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.926190 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.929245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:18.940584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1198/2435] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:18.944977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:18.955310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e30a7-1818-496d-b68b-483005dc55b9 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:18.960478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:18.961403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:18.961403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:18.961678 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] PATH_INFO: `/v3/projects/05ac1772c9564e949eb9c11292a132e7/users/a9dd7bf3900a4e9a887e705875ec0610/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:18.977315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ac1772c9564e949eb9c11292a132e7, user_id=a9dd7bf3900a4e9a887e705875ec0610, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:18.980008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:19.056742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1238/2436] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:18 2022] PUT /identity/v3/projects/05ac1772c9564e949eb9c11292a132e7/users/a9dd7bf3900a4e9a887e705875ec0610/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:19.060826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:19.070916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581bb9-71a0-4740-b0c1-b2a30da0fdea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:19.101837 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:19.127644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:19.128246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:19.128525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:19.128797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:19.129434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:19.131201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8d2b4-71cc-4b96-8d76-c6f29899d766 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:19.142434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1199/2437] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:42:19.146258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:19.156990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d803-d376-43cf-80b0-be17eff4bb31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:19.162265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:19.162908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:19.163187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:19.163461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] PATH_INFO: `/v3/projects/05ac1772c9564e949eb9c11292a132e7/users/a9dd7bf3900a4e9a887e705875ec0610/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:19.165403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ac1772c9564e949eb9c11292a132e7, user_id=a9dd7bf3900a4e9a887e705875ec0610, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:19.168178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:19.179968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1239/2438] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:19 2022] PUT /identity/v3/projects/05ac1772c9564e949eb9c11292a132e7/users/a9dd7bf3900a4e9a887e705875ec0610/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:19.190444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddce163-dd15-42fe-8c91-72a6c25d9f13 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:19.190738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddce163-dd15-42fe-8c91-72a6c25d9f13 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:19.191044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddce163-dd15-42fe-8c91-72a6c25d9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:19.222767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2ddce163-dd15-42fe-8c91-72a6c25d9f13 None None] MFA Rules not processed for user `a9dd7bf3900a4e9a887e705875ec0610`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:19.224812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2ddce163-dd15-42fe-8c91-72a6c25d9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:19.298435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1200/2439] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:19.309514 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:19.311316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:19.382764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9eca-c476-49f6-9e97-627300426694 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:19.386495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:19.387119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:19.387394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:19.387758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:19.448403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:19.449957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:19.455881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:19.461077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1240/2440] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:21.376992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e2d-aab6-4834-9f40-4e0987ad684e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:21.377434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e2d-aab6-4834-9f40-4e0987ad684e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:21.382889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e2d-aab6-4834-9f40-4e0987ad684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:21.397745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9f547e2d-aab6-4834-9f40-4e0987ad684e None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:21.398937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f547e2d-aab6-4834-9f40-4e0987ad684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:21.468000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1201/2441] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:21.486731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:21.488171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:21.560648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076231-e544-4c9a-a8cf-1f0225dbf069 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:21.565770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:21.566386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:21.566672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:21.566948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:21.580682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:21.582376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:21.591716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1241/2442] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 16:42:22.030178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:22.030483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:22.030968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:22.061830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:22.064959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:22.140976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:22.159259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1202/2443] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:22.195225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:22.195225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:22.303791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8693-6298-4458-b386-28a57672eb56 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:22.314566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:22.316043 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:22.316457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:22.318210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:22.336644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:22.340566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:22.353436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1242/2444] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:22.897881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:22.901940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:22.916697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a09b8-4ae7-42df-a1ab-cb6d378c4d5c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:22.930964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:22.931651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:22.931921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:22.932388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:22.944813 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:22.946610 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8f111-334b-4445-8734-45ff5c1ecad0 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:22.956922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1203/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:24.232929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:24.260714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945c256-bf3d-48f7-92d4-ea18d1039403 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:24.268683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:24.269432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:24.271714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:24.272145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:24.274477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:24.291664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:24.314584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:24.354216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1243/2446] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:27.881153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd08e-d9c7-4395-bb75-3fdfe8b72860 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:27.881755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd08e-d9c7-4395-bb75-3fdfe8b72860 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:27.881755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd08e-d9c7-4395-bb75-3fdfe8b72860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:27.904458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-83fbd08e-d9c7-4395-bb75-3fdfe8b72860 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:27.906619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-83fbd08e-d9c7-4395-bb75-3fdfe8b72860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:27.916967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1204/2447] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:27.956210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:27.957906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:27.972957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa27-bade-4ee1-b45c-fcf28453d9f7 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:27.979329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:27.980390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:27.980674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:27.980942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:28.025114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:28.026991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:28.047940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1244/2448] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:32.814557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8590b-65d2-433a-8eb8-a2ca58357b55 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:32.815017 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8590b-65d2-433a-8eb8-a2ca58357b55 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:32.815213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8590b-65d2-433a-8eb8-a2ca58357b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:32.835601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-68a8590b-65d2-433a-8eb8-a2ca58357b55 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:32.836886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-68a8590b-65d2-433a-8eb8-a2ca58357b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:32.844797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1205/2449] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:32.868730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:32.879938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc088-200a-4e65-87c6-67cf48633e55 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:32.886045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:32.886644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:32.886924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:32.887197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:32.895797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:32.898162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:32.908072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1245/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:42:37.062413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911da14b-4d21-456d-af08-826941437fb0 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:37.062934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911da14b-4d21-456d-af08-826941437fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:37.063121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911da14b-4d21-456d-af08-826941437fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:37.084243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-911da14b-4d21-456d-af08-826941437fb0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:37.085573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-911da14b-4d21-456d-af08-826941437fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:37.094375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1206/2451] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:37.116111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:37.127314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33fc39-549b-4fa5-8214-40f97cecf48e service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:37.134015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:37.134711 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:37.135558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:37.135558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:37.144358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:37.146528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5037-4b6e-4487-8776-894913497f0a service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:37.156814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1246/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:39.035944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911da14b-4d21-456d-af08-826941437fb0 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:39.045787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911da14b-4d21-456d-af08-826941437fb0 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:39.050386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:39.050948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:39.051227 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:39.051518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] PATH_INFO: `/v3/users/7561f9d0c6964711a352bcc73c3e26d8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:39.053281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7561f9d0c6964711a352bcc73c3e26d8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:39.055310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:39.259733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7561f9d0c6964711a352bcc73c3e26d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:39.260375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7561f9d0c6964711a352bcc73c3e26d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:39.267958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7561f9d0c6964711a352bcc73c3e26d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:39.295345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7561f9d0c6964711a352bcc73c3e26d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:39.412727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7561f9d0c6964711a352bcc73c3e26d8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:39.419845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1207/2453] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:39 2022] DELETE /identity/v3/users/7561f9d0c6964711a352bcc73c3e26d8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:39.424561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:39.425034 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:39.425144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:39.446160 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:39.447399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:39.466758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:39.511136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1247/2454] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:39.522050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:39.523424 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:39.582746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48a84-86ee-49e7-bcd8-5e7627338f59 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:39.586805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:39.587556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:39.593181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:39.593181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:39.599594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:39.601236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:39.611782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1208/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:40.057670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:40.059133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:40.071998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4650c-470a-4301-ba83-1396d5c8c3ba None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:40.077843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:40.078817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:40.079457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:40.079931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] PATH_INFO: `/v3/projects/1683a302ebc347a9bcc92d58b6f693a6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:40.081593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1683a302ebc347a9bcc92d58b6f693a6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:40.083079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:40.221093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1683a302ebc347a9bcc92d58b6f693a6', 'request_id': 'req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.227094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1683a302ebc347a9bcc92d58b6f693a6', 'request_id': 'req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.316506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1683a302ebc347a9bcc92d58b6f693a6', 'request_id': 'req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.329087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] The token cache is being invalidate because project 1683a302ebc347a9bcc92d58b6f693a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:40.329388 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.330170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.331672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1248/2456] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:40 2022] DELETE /identity/v3/projects/1683a302ebc347a9bcc92d58b6f693a6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:40.335863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:40.345870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebb2a-7b5b-4623-868a-4e91f7119691 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:40.388293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:40.405399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:40.406057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:40.406330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:40.406606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] PATH_INFO: `/v3/users/a9dd7bf3900a4e9a887e705875ec0610` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:40.407782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dd7bf3900a4e9a887e705875ec0610)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:40.412522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:40.630044 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:40.631546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:40.689046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecdb7-cf09-4fd0-8fa2-c62bd129bfeb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:40.691667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dd7bf3900a4e9a887e705875ec0610'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.692330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dd7bf3900a4e9a887e705875ec0610'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.692731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:40.693346 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:40.693660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:40.693954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:40.695747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:40.699865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dd7bf3900a4e9a887e705875ec0610'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.705522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:40.707158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:40.713436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dd7bf3900a4e9a887e705875ec0610'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.716380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1249/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:42:40.803730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-d64af30c-207d-4d84-b3cf-44f76e1a4540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dd7bf3900a4e9a887e705875ec0610'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:40.810605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1209/2458] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:40 2022] DELETE /identity/v3/users/a9dd7bf3900a4e9a887e705875ec0610 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:41.244202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:41.245745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:41.265134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4704d-e399-4711-a7fe-b5bf37c2e4c3 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:41.332295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:41.345608 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:41.346262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.346547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.346880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] PATH_INFO: `/v3/projects/05ac1772c9564e949eb9c11292a132e7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.348080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ac1772c9564e949eb9c11292a132e7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:41.350755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:41.351600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.352042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.352300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.385653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:41.386870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:41.395039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1210/2459] 10.222.0.76 () {58 vars in 1016 bytes} [Fri Aug 19 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:42:41.416604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:41.417933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:41.483675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ac1772c9564e949eb9c11292a132e7', 'request_id': 'req-32147fc4-a85c-49c8-86af-e75b86e64015'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:41.490767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ac1772c9564e949eb9c11292a132e7', 'request_id': 'req-32147fc4-a85c-49c8-86af-e75b86e64015'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:41.496804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a5160-5a6a-43af-898f-293d61cf11df None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:41.547647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:41.560057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ac1772c9564e949eb9c11292a132e7', 'request_id': 'req-32147fc4-a85c-49c8-86af-e75b86e64015'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:41.567122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:41.568459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.568748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.569024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.574086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] The token cache is being invalidate because project 05ac1772c9564e949eb9c11292a132e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:41.574814 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:41.575204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-32147fc4-a85c-49c8-86af-e75b86e64015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:41.577046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1250/2460] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:41 2022] DELETE /identity/v3/projects/05ac1772c9564e949eb9c11292a132e7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:41.581609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.582467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.582932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.612990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:41.612990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:41.637929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:41.642579 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6854511-29d9-48bc-8ff9-cbdb783a2a5e service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:41.652234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1211/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:42:41.671792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1251/2462] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:42:41.679402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.679771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.680001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.702558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:41.703872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:41.713489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1212/2463] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:41.717093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:41.727836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1d2b5-e0d0-4abc-bae2-978c68813026 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:41.732553 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:41.733171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.733460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.733811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.734629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:42:41.734945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:41.736603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:41.751222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1252/2464] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:42:41.756326 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:41.765651 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c5d0-8330-4ddc-8612-a2613c4d53e4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:41.770332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:41.771667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:41.772122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:41.772400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:41.773039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:41.775210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:41.949389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1213/2465] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:41 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:42:41.953580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:41.963631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f161b-cb0c-4fff-abbf-c9fc716ba4cb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.021609 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.022212 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.022496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.022771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.023400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.025613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.036655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:42.101329 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1253/2466] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:41 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:42.105458 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.116503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b287e-a0a0-4269-947d-e150fb894c08 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.121109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.121714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.121994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.122268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.122913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.124551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.135687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1214/2467] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:42.139541 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.149949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af15306-6813-4be3-a811-603ad4d10a71 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.154822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.161907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.161907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.161907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.161907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.161907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0a2c-e9ae-4ff3-b917-024981e328d4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.170207 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1254/2468] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:42.174952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.186376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cbf-15e1-4d8c-b079-46bd3c4cbd1a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.191298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.191984 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.192261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.193198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] PATH_INFO: `/v3/projects/1d389854e5af4c7eb802ffb014c82557/users/7a9eb136d450423e8e153d6d6f81f6f9/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.207896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d389854e5af4c7eb802ffb014c82557, user_id=7a9eb136d450423e8e153d6d6f81f6f9, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.210454 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.309505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1215/2469] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:42 2022] PUT /identity/v3/projects/1d389854e5af4c7eb802ffb014c82557/users/7a9eb136d450423e8e153d6d6f81f6f9/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:42:42.319936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.320223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.320498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.352841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] MFA Rules not processed for user `7a9eb136d450423e8e153d6d6f81f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:42.354067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:42.419341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1255/2470] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:42:42.423867 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.490088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac6a7-a6a0-4299-a29d-4aa5910fd3ce admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.495039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.495677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.495956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.496231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.496855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.498732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.630727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1216/2471] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:42.634846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.645749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960e4a-28de-446d-aabf-3aac13e088d2 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.704069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.704754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.704951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.705227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.705847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.707821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.829927 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1256/2472] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:42 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:42:42.834434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.844817 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ab40-8b39-4993-b13b-6423daffd6ff admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.849389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.849997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.850278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.850552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.851198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.852848 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.854288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:42.864397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1217/2473] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:42:42.869233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.880053 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528956a-5942-4a41-99e8-221fcce89e52 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.885699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.886300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.886582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.886859 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.887525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.889143 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b696a-3b2e-4a58-91af-bb70b8e347cd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:42.899624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1257/2474] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:42.903726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:42.914133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badd052-be7c-4ad6-a5ab-2de6e9510566 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:42.919029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:42.919872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:42.923960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:42.923960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] PATH_INFO: `/v3/projects/40df01268a484d4c8c0e3efcf60985ce/users/95a16eb762604b379d30440112786fe6/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:42.935603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40df01268a484d4c8c0e3efcf60985ce, user_id=95a16eb762604b379d30440112786fe6, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:42.938234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.049175 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1218/2475] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:42 2022] PUT /identity/v3/projects/40df01268a484d4c8c0e3efcf60985ce/users/95a16eb762604b379d30440112786fe6/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:43.061237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.061540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.061833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.089316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] MFA Rules not processed for user `95a16eb762604b379d30440112786fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:43.090557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:43.132777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:43.158120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1258/2476] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:43.160791 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.229499 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcdc64-7e10-4023-9277-e4ae289ede7d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.235216 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.235994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.236285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.236566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.237204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.239274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.381911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1219/2477] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:42:43.382016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.391670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc0434-5800-4a4e-9e5f-0f674bc4d9e3 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.449997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.450624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.450908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.451189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.451893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.453930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.543532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1259/2478] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:42:43 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:42:43.547297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.558254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7cf2d-9752-4f54-bce9-c6902e30d7d8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.563090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.563797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.564085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.564366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.565008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.566613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.580722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1220/2479] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:43.581955 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.592416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f3f58-026d-492c-9a52-455e1288500c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.597024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.597669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.597950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.598230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] PATH_INFO: `/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa/users/27e766e532b14fb591bfceedde2b924c/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.613848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8f9e52b9af41c0bc27b1d2fafabcfa, user_id=27e766e532b14fb591bfceedde2b924c, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.616632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.685181 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1260/2480] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:43 2022] PUT /identity/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa/users/27e766e532b14fb591bfceedde2b924c/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:43.689145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.699032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d1aff-1591-40bb-bd45-d211c73ff905 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.758552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.759164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.759451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.759759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.760411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.762008 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352812b4-e092-4301-885e-43c7aa8c00d3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.772370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1221/2481] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:42:43.777664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.788681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680ee3-3a08-430a-ae40-40a4ef7e7367 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:43.793635 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:43.797564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.797564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.797564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] PATH_INFO: `/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa/users/27e766e532b14fb591bfceedde2b924c/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.797564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8f9e52b9af41c0bc27b1d2fafabcfa, user_id=27e766e532b14fb591bfceedde2b924c, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:43.799513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:43.810317 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1261/2482] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:42:43 2022] PUT /identity/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa/users/27e766e532b14fb591bfceedde2b924c/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:43.821373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:43.821665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:43.821962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:43.850719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] MFA Rules not processed for user `27e766e532b14fb591bfceedde2b924c`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:43.855368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:43.882447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:43.926325 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1222/2483] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:43.937395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:43.939078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:43.997547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218a069-55e5-4e57-8014-db6871d4e625 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:44.001472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:44.002082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:44.002435 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:44.002622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:44.012829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:44.014259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2ff70-3d8d-4209-983a-c5c126b15f76 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:44.024907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1262/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:45.167244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:45.176886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e2ec-8379-4d35-82b9-d43546f1f6a7 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:45.181404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:45.182154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:45.182500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:45.182841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:45.240776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:45.241907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:45.251475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1223/2485] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:45.642187 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:45.642704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:45.642799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:45.664370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:45.665607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:45.700513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:45.723152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1263/2486] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:45.735853 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:45.737429 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:45.817597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79678e-3b67-4dd6-9eb6-34aa13ca9d33 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:45.823735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:45.824359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:45.824641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:45.824918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:45.833546 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:45.835246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:45.843319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1224/2487] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:42:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:42:50.414362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:50.416399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:50.428463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c64a-fca6-4865-9f21-42e54e47dee5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:50.432325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:50.433039 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:50.433392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:50.433741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:50.497660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:50.499107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22c3d-84e3-47d0-9f37-91c30ef2500e service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:50.509535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1264/2488] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:42:55.840179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=75 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:56.440836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:56.508058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a921-f045-4c7e-a9f2-70bd7c35f70e service swift] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:56.512772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:56.513398 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:56.513678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:56.513957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] PATH_INFO: `/v3/users/7a9eb136d450423e8e153d6d6f81f6f9` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:56.515093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9eb136d450423e8e153d6d6f81f6f9)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:56.517063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:56.703925 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9eb136d450423e8e153d6d6f81f6f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:56.704511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9eb136d450423e8e153d6d6f81f6f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:56.712162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9eb136d450423e8e153d6d6f81f6f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:56.724117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9eb136d450423e8e153d6d6f81f6f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:56.835556 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9eb136d450423e8e153d6d6f81f6f9'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:56.849981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1225/2489] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:56 2022] DELETE /identity/v3/users/7a9eb136d450423e8e153d6d6f81f6f9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:42:56.850524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:56.850524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:56.850524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:56.874038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:42:56.875264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:56.944945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1265/2490] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:42:56.954827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:56.956391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:57.016906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668eaac-54b3-4db9-9e1c-a3f948f5c3e1 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:57.020617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:57.021224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:57.021504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:57.021781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:57.031762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:57.033197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:57.043019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1226/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:42:57.441172 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:57.442861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:57.455309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2de0b-9e0b-4d1c-89e6-2d2166923a3b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:57.460786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:57.461334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:57.461662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:57.461896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] PATH_INFO: `/v3/projects/1d389854e5af4c7eb802ffb014c82557` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:57.463074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d389854e5af4c7eb802ffb014c82557)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:57.465030 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:57.582730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d389854e5af4c7eb802ffb014c82557', 'request_id': 'req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.588795 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d389854e5af4c7eb802ffb014c82557', 'request_id': 'req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.650932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d389854e5af4c7eb802ffb014c82557', 'request_id': 'req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.663295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] The token cache is being invalidate because project 1d389854e5af4c7eb802ffb014c82557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:57.669355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.669355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.669355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1266/2492] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:57 2022] DELETE /identity/v3/projects/1d389854e5af4c7eb802ffb014c82557 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:57.669784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:57.679615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d59c-e5cd-4dd8-8ec0-14572d8f01cc service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:57.698399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:57.737903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:57.738464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:57.738816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:57.739267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] PATH_INFO: `/v3/users/95a16eb762604b379d30440112786fe6` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:57.740642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a16eb762604b379d30440112786fe6)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:57.742999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:57.955945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a16eb762604b379d30440112786fe6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.956609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a16eb762604b379d30440112786fe6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.963869 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a16eb762604b379d30440112786fe6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:57.976539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a16eb762604b379d30440112786fe6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.054884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a16eb762604b379d30440112786fe6'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.061545 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1227/2493] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:57 2022] DELETE /identity/v3/users/95a16eb762604b379d30440112786fe6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:58.659358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:58.661538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:58.671883 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:58.675458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8483-da7f-4c89-8dde-9ae753a8dc6c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:58.738936 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:58.739637 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:58.739931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:58.740209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] PATH_INFO: `/v3/projects/40df01268a484d4c8c0e3efcf60985ce` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:58.741382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40df01268a484d4c8c0e3efcf60985ce)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:58.743299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:58.851379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40df01268a484d4c8c0e3efcf60985ce', 'request_id': 'req-31e189be-e16f-44b3-98d6-fa06f07168b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.856766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40df01268a484d4c8c0e3efcf60985ce', 'request_id': 'req-31e189be-e16f-44b3-98d6-fa06f07168b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.936426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40df01268a484d4c8c0e3efcf60985ce', 'request_id': 'req-31e189be-e16f-44b3-98d6-fa06f07168b3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.949157 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] The token cache is being invalidate because project 40df01268a484d4c8c0e3efcf60985ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:42:58.949502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.950294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:58.951844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1267/2494] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:58 2022] DELETE /identity/v3/projects/40df01268a484d4c8c0e3efcf60985ce => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:42:58.956156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:58.957457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:58.971802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8adb3-782f-45b2-8aab-1c116b2e578d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:59.029364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:59.029983 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:59.030262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:59.030536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] PATH_INFO: `/v3/users/27e766e532b14fb591bfceedde2b924c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:59.031692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e766e532b14fb591bfceedde2b924c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:59.033601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:59.240402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:59.242976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e766e532b14fb591bfceedde2b924c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.243674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e766e532b14fb591bfceedde2b924c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.250554 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e766e532b14fb591bfceedde2b924c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.263740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e766e532b14fb591bfceedde2b924c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.317841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-b678599a-9267-4bcf-a79c-b672d7a91996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e766e532b14fb591bfceedde2b924c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.324095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1228/2495] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:42:58 2022] DELETE /identity/v3/users/27e766e532b14fb591bfceedde2b924c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:42:59.766419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:42:59.768436 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:42:59.784488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e189be-e16f-44b3-98d6-fa06f07168b3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:42:59.847513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:42:59.848167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:42:59.848458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:42:59.849275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] PATH_INFO: `/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:42:59.850600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8f9e52b9af41c0bc27b1d2fafabcfa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:42:59.852580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:42:59.947313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:59.956825 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8f9e52b9af41c0bc27b1d2fafabcfa', 'request_id': 'req-d50bfb8a-be63-4a38-8759-07761fdb0c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:42:59.962890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8f9e52b9af41c0bc27b1d2fafabcfa', 'request_id': 'req-d50bfb8a-be63-4a38-8759-07761fdb0c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:00.045767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8f9e52b9af41c0bc27b1d2fafabcfa', 'request_id': 'req-d50bfb8a-be63-4a38-8759-07761fdb0c50'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:00.059086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] The token cache is being invalidate because project af8f9e52b9af41c0bc27b1d2fafabcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:00.059946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:00.060069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d50bfb8a-be63-4a38-8759-07761fdb0c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:00.061515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1268/2496] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:42:59 2022] DELETE /identity/v3/projects/af8f9e52b9af41c0bc27b1d2fafabcfa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:00.067672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.068161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.068254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.088547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:00.089790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:00.149059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1229/2497] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:00.158501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.158784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.159066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.179604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:00.180816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:00.188772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1269/2498] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:00.192895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.202487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324ca9-0961-433e-9447-c81ea06b8961 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.207648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.209162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.209455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.209743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.210407 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:00.210712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.212370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.225449 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1230/2499] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:00.232406 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.241802 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05914a53-f855-41f1-9df8-fe47d8a19367 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.246484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.247078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.247367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.247681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.248312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.250215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.336627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1270/2500] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:00.340998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.351427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51bac6-a13a-40a8-9594-be37f4471f18 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.408296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.408907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.409193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.409472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.410128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.412103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.523731 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1231/2501] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:00.527908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.538311 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2626e1-a471-43b9-93a5-ad589f721e89 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.542881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.543474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.543781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.544058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.544721 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.546322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.556082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1271/2502] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:00.559781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.570400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1498-9843-49e6-be14-7f8812775dec admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.575152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.575856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.576169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.576444 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.577086 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.578713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c808c2-99eb-4763-a6a2-ca55c7f430c3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.590025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1232/2503] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:00.593877 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.603756 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc199-7716-4858-ab97-1a187e921b28 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.608245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.609894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.610177 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.610453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] PATH_INFO: `/v3/projects/e00bbaa1ae6740d9916953e50f6fc825/users/1647f3df25324ffe93e140b3d32ad1a5/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.626533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00bbaa1ae6740d9916953e50f6fc825, user_id=1647f3df25324ffe93e140b3d32ad1a5, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.629214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:00.712885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1272/2504] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:00 2022] PUT /identity/v3/projects/e00bbaa1ae6740d9916953e50f6fc825/users/1647f3df25324ffe93e140b3d32ad1a5/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:00.724184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.724475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.724756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.758593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] MFA Rules not processed for user `1647f3df25324ffe93e140b3d32ad1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:00.759905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:00.772878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:00.826770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1233/2505] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:00.831360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:00.901117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4edd-573f-499e-9bd7-98d93cfc5e02 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:00.905826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:00.906486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:00.906798 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:00.907074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:00.907742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:00.909641 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.003469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1273/2506] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:00 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:01.005026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.015948 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828eb88-30ad-439e-ae1e-2f4acaeaa42c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.075715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.076354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.076636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.076908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.077542 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.079834 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.169614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1234/2507] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:01 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:01.174202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.186415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8183-2335-4f93-99a5-b5fe67ec26a8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.191931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.193235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.193582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.193862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.194513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.196230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.207243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1274/2508] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:01.212382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.222315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdacfd9-8ee3-48a5-aea8-6e3bda072c29 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.227132 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.227815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.229506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.229506 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] PATH_INFO: `/v3/projects/dc90ed78fa5141278e2b97db39974645/users/fc241a94727a411bbec86dbe0a3e1031/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.243285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc90ed78fa5141278e2b97db39974645, user_id=fc241a94727a411bbec86dbe0a3e1031, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.245977 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.336414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1235/2509] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:01 2022] PUT /identity/v3/projects/dc90ed78fa5141278e2b97db39974645/users/fc241a94727a411bbec86dbe0a3e1031/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:01.342226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.352530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2441241-5ef1-409d-9a2d-0c0535e5a4e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.392293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:01.419102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.424800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.424800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.424800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.424800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.424800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b92edd-1b36-42f0-9a73-d06022bb1ee1 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.433830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1275/2510] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:01.438025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.449677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4825-c6f3-4205-b910-68094eccb7e3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.454815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.456126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.456126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.456126 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] PATH_INFO: `/v3/projects/dc90ed78fa5141278e2b97db39974645/users/fc241a94727a411bbec86dbe0a3e1031/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.458119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc90ed78fa5141278e2b97db39974645, user_id=fc241a94727a411bbec86dbe0a3e1031, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.460912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.471358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1236/2511] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:01 2022] PUT /identity/v3/projects/dc90ed78fa5141278e2b97db39974645/users/fc241a94727a411bbec86dbe0a3e1031/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:01.482203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.482484 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.482759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.512350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] MFA Rules not processed for user `fc241a94727a411bbec86dbe0a3e1031`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:01.513632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:01.584280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1276/2512] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:01.595690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:01.597496 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:01.663097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bb27-2f7b-4c4e-afa4-72487dbdf873 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:01.666974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:01.667762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:01.668200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:01.668550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:01.678840 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:01.681185 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c83c3-d489-44b8-bd72-5e13f689f644 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:01.693085 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1237/2513] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:02.859344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:02.928601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c57d-742d-418e-91c4-fce6768d2553 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:02.933274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:02.933908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:02.934201 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:02.939176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] PATH_INFO: `/v3/users/1647f3df25324ffe93e140b3d32ad1a5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:02.939176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1647f3df25324ffe93e140b3d32ad1a5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:02.939176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:03.086442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1647f3df25324ffe93e140b3d32ad1a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:03.093276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1647f3df25324ffe93e140b3d32ad1a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:03.093881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1647f3df25324ffe93e140b3d32ad1a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:03.095790 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:03.105857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1647f3df25324ffe93e140b3d32ad1a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:03.106504 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1647f3df25324ffe93e140b3d32ad1a5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:03.178898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1277/2514] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:02 2022] DELETE /identity/v3/users/1647f3df25324ffe93e140b3d32ad1a5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:03.185772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734165-7949-4d9b-8b02-f0ded43131fb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:03.185772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734165-7949-4d9b-8b02-f0ded43131fb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:03.185772 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734165-7949-4d9b-8b02-f0ded43131fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:03.206254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d2734165-7949-4d9b-8b02-f0ded43131fb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:03.206254 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d2734165-7949-4d9b-8b02-f0ded43131fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:03.211274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:03.274852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1238/2515] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:03.281391 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:03.283150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:03.377422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eb1b5-0627-4c5b-bbe3-c03b7c8cd666 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:03.383138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:03.384147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:03.391343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:03.391343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:03.396186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:03.396642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:03.397021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:03.399461 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:03.400959 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:03.422199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1278/2516] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:03.422677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] MFA Rules not processed for user `7ed5539c0c71499c95a31152732943c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:03.424090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:03.491260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1239/2517] 10.222.0.43 () {58 vars in 967 bytes} [Fri Aug 19 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:03.504418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:03.505920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:03.576313 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610f13-ef55-40a3-854c-e48aa9e0b924 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:03.581453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c98929303e0e420e85db06478eb3d8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:03.582058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:03.582344 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:03.582632 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:03.591423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:03.593156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:03.602199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1279/2518] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Aug 19 16:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 16:43:03.922852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:03.924622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:03.941075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d713-0e61-4aaa-a11c-0602cb80ca6c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:03.947839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:03.948565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:03.949052 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:03.949388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] PATH_INFO: `/v3/projects/e00bbaa1ae6740d9916953e50f6fc825` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:03.950628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00bbaa1ae6740d9916953e50f6fc825)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:03.952779 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:04.080050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00bbaa1ae6740d9916953e50f6fc825', 'request_id': 'req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.085576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00bbaa1ae6740d9916953e50f6fc825', 'request_id': 'req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.140512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00bbaa1ae6740d9916953e50f6fc825', 'request_id': 'req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.153889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] The token cache is being invalidate because project e00bbaa1ae6740d9916953e50f6fc825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:04.154179 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.154804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.156301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1240/2519] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:03 2022] DELETE /identity/v3/projects/e00bbaa1ae6740d9916953e50f6fc825 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:04.160427 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:04.177439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760916-65c1-4624-a2c7-1836a8ef2ae7 service swift] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:04.230852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:04.231515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:04.235657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:04.235657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] PATH_INFO: `/v3/users/fc241a94727a411bbec86dbe0a3e1031` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:04.235657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc241a94727a411bbec86dbe0a3e1031)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:04.235657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:04.248243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:04.428382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc241a94727a411bbec86dbe0a3e1031'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.435117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc241a94727a411bbec86dbe0a3e1031'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.435807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc241a94727a411bbec86dbe0a3e1031'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.447634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc241a94727a411bbec86dbe0a3e1031'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.448358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ea5c45a9-a4b7-478e-9dee-0d09c745a30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc241a94727a411bbec86dbe0a3e1031'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:04.565601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1280/2520] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:04 2022] DELETE /identity/v3/users/fc241a94727a411bbec86dbe0a3e1031 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:05.012362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.013833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:05.027970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a712dd-b02e-4fe0-b34f-e6643bbe3e19 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.069919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:05.088943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.089632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.089917 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.090195 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] PATH_INFO: `/v3/projects/dc90ed78fa5141278e2b97db39974645` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.091328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc90ed78fa5141278e2b97db39974645)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.093292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.178650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc90ed78fa5141278e2b97db39974645', 'request_id': 'req-e5760dfe-4da4-4237-bb58-296a721d0c5f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:05.184028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc90ed78fa5141278e2b97db39974645', 'request_id': 'req-e5760dfe-4da4-4237-bb58-296a721d0c5f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:05.254396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc90ed78fa5141278e2b97db39974645', 'request_id': 'req-e5760dfe-4da4-4237-bb58-296a721d0c5f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:05.266128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] The token cache is being invalidate because project dc90ed78fa5141278e2b97db39974645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:05.266359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:05.267021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-e5760dfe-4da4-4237-bb58-296a721d0c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:05.268563 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1241/2521] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:05 2022] DELETE /identity/v3/projects/dc90ed78fa5141278e2b97db39974645 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:05.274185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.274607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.275016 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.307907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:05.309248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:05.376075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1281/2522] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:05.383852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.384147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.384427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.405075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:05.406285 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:05.415447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1242/2523] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:05.419948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.429779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f2a4-37ba-409c-998c-8779f4d97524 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.434689 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.435382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.435705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.436090 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.436761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:05.437111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.438985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.455692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1282/2524] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:05.456734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.466748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d90238-88f1-458a-97c6-d0262c4438e6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.471669 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.472279 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.472567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.472843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.473488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.475519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.573695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1243/2525] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:05 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:05.577873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.589165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1d88-ee86-493c-9aa8-618191e533eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.676122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.676743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.677031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.677314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.678149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.680174 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.779603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1283/2526] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:05 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:05.783382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.794571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e74-64b2-4d1b-a60e-729a83145e28 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.799235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.807058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.807058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.807058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.807058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.807058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.813590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1244/2527] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:05.817611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.825077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:05.831350 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b51-d366-45b6-b0e9-41708868d820 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.837612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.838235 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.838517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.838794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.839451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.841092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f6f3a-cba5-4e05-85a3-04c3e9b1fe4e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:05.852600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1284/2528] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:05.856598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:05.880196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ae2c-aebf-4cc0-b76d-975b0bcc773a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:05.885534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:05.886203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:05.886577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:05.886823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] PATH_INFO: `/v3/projects/999e81c4a4764264bd67a805e8cdd0d6/users/c84654932e064c96ac9c763af411f79e/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:05.902012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=999e81c4a4764264bd67a805e8cdd0d6, user_id=c84654932e064c96ac9c763af411f79e, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:05.904773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.003939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1245/2529] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:05 2022] PUT /identity/v3/projects/999e81c4a4764264bd67a805e8cdd0d6/users/c84654932e064c96ac9c763af411f79e/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:06.015071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.015358 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.015665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.042992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] MFA Rules not processed for user `c84654932e064c96ac9c763af411f79e`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:06.044258 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:06.113233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1285/2530] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:06.117709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.181332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be41c6-1c20-4b79-ad01-f5ea486869cc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.185910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.186515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.186824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.187101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.187754 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.192693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.212952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:06.293073 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1246/2531] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:06 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:06.297249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.309110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef041e3-bea3-4211-aa70-f172f6514300 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.373975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.374586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.374867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.375156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.375804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.377752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.498129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1286/2532] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:06 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:06.502557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.512709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e52f4-8751-43a1-b906-4cf25004a7db admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.517291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.517888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.518170 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.518447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.519090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.520737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.531902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1247/2533] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:06.536214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.547208 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873432f4-0b66-4791-924c-8d6fd79a3940 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.551748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.552408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.553482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.553809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] PATH_INFO: `/v3/projects/c5dca92205b149e1ae464c42390153e2/users/1f85cb7b3a7b4068b2ecc810c51a11ea/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.568652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dca92205b149e1ae464c42390153e2, user_id=1f85cb7b3a7b4068b2ecc810c51a11ea, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.571590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.669591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1287/2534] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:06 2022] PUT /identity/v3/projects/c5dca92205b149e1ae464c42390153e2/users/1f85cb7b3a7b4068b2ecc810c51a11ea/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:06.675643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.685769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1fce-7772-4a81-94bc-dcf3f4fa7b51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.743040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.743724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.744013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.744293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.744941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.746589 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640426-c8a5-4843-af17-c6d5569b1d50 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.756970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1248/2535] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:06.761556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.772627 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426bee2-6ff7-4465-838d-994ca914fcad admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:06.777867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:06.778509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.780268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.780268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] PATH_INFO: `/v3/projects/c5dca92205b149e1ae464c42390153e2/users/1f85cb7b3a7b4068b2ecc810c51a11ea/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.781074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dca92205b149e1ae464c42390153e2, user_id=1f85cb7b3a7b4068b2ecc810c51a11ea, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:06.783807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:06.795257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1288/2536] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:06 2022] PUT /identity/v3/projects/c5dca92205b149e1ae464c42390153e2/users/1f85cb7b3a7b4068b2ecc810c51a11ea/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:06.864117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:06.864406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:06.864687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:06.892259 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] MFA Rules not processed for user `1f85cb7b3a7b4068b2ecc810c51a11ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:06.893425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:06.961893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1249/2537] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:06.973229 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:06.975288 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:07.022862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:07.041159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14e66-532e-400e-ba62-9d7bddd0dc05 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:07.044910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:07.045550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:07.045836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:07.046115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:07.102410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:07.103878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c396b3d-7dc6-430e-849f-57f1ba1bc2fc service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:07.113410 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1289/2538] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:10.364248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:10.430116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d46418-87e6-41cd-bbcc-0789f72e8733 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:10.434957 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:10.435661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:10.435949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:10.436231 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] PATH_INFO: `/v3/users/c84654932e064c96ac9c763af411f79e` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:10.437518 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84654932e064c96ac9c763af411f79e)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:10.439349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:10.441896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:10.624118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84654932e064c96ac9c763af411f79e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:10.624739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84654932e064c96ac9c763af411f79e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:10.633319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84654932e064c96ac9c763af411f79e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:10.646205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84654932e064c96ac9c763af411f79e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:10.708898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84654932e064c96ac9c763af411f79e'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:10.716250 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1250/2539] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:10 2022] DELETE /identity/v3/users/c84654932e064c96ac9c763af411f79e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:10.723879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:10.724360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:10.724558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:10.761211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:10.762418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:10.824913 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1290/2540] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:10.834550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:10.836236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:10.897437 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8746bf-f0a2-4495-bfe8-b2a2aa1fde47 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:10.915354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:10.915354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:10.915354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:10.915354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:10.916832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:10.918293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:10.930193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1251/2541] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:11.321612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:11.323334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:11.337256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848202-032e-48ed-a777-308ab50faa58 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:11.342289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:11.342975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:11.343255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:11.343561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] PATH_INFO: `/v3/projects/999e81c4a4764264bd67a805e8cdd0d6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:11.344815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999e81c4a4764264bd67a805e8cdd0d6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:11.346842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:11.495142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999e81c4a4764264bd67a805e8cdd0d6', 'request_id': 'req-f074463d-fa32-47ea-b2dc-75126b0568e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.495142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999e81c4a4764264bd67a805e8cdd0d6', 'request_id': 'req-f074463d-fa32-47ea-b2dc-75126b0568e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.564962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999e81c4a4764264bd67a805e8cdd0d6', 'request_id': 'req-f074463d-fa32-47ea-b2dc-75126b0568e3'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.577843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] The token cache is being invalidate because project 999e81c4a4764264bd67a805e8cdd0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:11.578194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.578870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.580482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1291/2542] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:11 2022] DELETE /identity/v3/projects/999e81c4a4764264bd67a805e8cdd0d6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:11.584418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:11.595916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e60a-d691-485b-a76d-78ba39647d61 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:11.657904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:11.658540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:11.658822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:11.659097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] PATH_INFO: `/v3/users/1f85cb7b3a7b4068b2ecc810c51a11ea` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:11.660270 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f85cb7b3a7b4068b2ecc810c51a11ea)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:11.662207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:11.743713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:11.845501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f85cb7b3a7b4068b2ecc810c51a11ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.846418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f85cb7b3a7b4068b2ecc810c51a11ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.854472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f85cb7b3a7b4068b2ecc810c51a11ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:11.877504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f85cb7b3a7b4068b2ecc810c51a11ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.016587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ff020799-46a9-4f08-bf91-a4211d68fef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f85cb7b3a7b4068b2ecc810c51a11ea'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.026281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1252/2543] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:11 2022] DELETE /identity/v3/users/1f85cb7b3a7b4068b2ecc810c51a11ea => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:12.522261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:12.525464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:12.543261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074463d-fa32-47ea-b2dc-75126b0568e3 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:12.556935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:12.613367 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:12.615077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:12.615077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:12.615077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] PATH_INFO: `/v3/projects/c5dca92205b149e1ae464c42390153e2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:12.615850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5dca92205b149e1ae464c42390153e2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:12.618595 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:12.736998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5dca92205b149e1ae464c42390153e2', 'request_id': 'req-133acecf-f913-4b6e-99b7-1640be0f63ed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.740002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5dca92205b149e1ae464c42390153e2', 'request_id': 'req-133acecf-f913-4b6e-99b7-1640be0f63ed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.828981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5dca92205b149e1ae464c42390153e2', 'request_id': 'req-133acecf-f913-4b6e-99b7-1640be0f63ed'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.843065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] The token cache is being invalidate because project c5dca92205b149e1ae464c42390153e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:12.843363 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.844047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-133acecf-f913-4b6e-99b7-1640be0f63ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:12.845572 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1292/2544] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:12 2022] DELETE /identity/v3/projects/c5dca92205b149e1ae464c42390153e2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:12.851585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:12.852118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:12.852514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:12.872282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:12.873501 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:12.937383 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1253/2545] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:12.945770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:12.946339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:12.946656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:12.967195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:12.968581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:12.976418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1293/2546] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:12.980783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:12.990564 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9eded-88e0-4036-a5d2-5f3bf5b07af3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:12.995135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:12.995771 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:12.996054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:12.996328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:12.996979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:12.997288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:12.998901 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.012162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1254/2547] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:43:13.015668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.026536 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9311cf-f8fa-406b-92ad-cb4ffbe6f58a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.031327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.032061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.032352 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.032638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.033295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.036998 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.129665 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1294/2548] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:13 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:13.134533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.147662 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8071-b338-4468-8eae-002689f029f9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.206621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.207332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.207690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.207970 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.208608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.211137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.302626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1255/2549] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:13 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:13.307943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.318251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377b3c-0773-47b2-936c-5983874cbb77 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.323796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.326147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.326147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.326147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.326147 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.327833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.338154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1295/2550] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:13.342379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.352863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c479c-d641-4811-ba2a-270af31509ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.357765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.358373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.358664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.358962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.360114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.361272 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0debab9-2f0f-40ea-b465-3d516ed7c9b0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.372789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1256/2551] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:13.377040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.387981 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfeb1-8e40-40ec-b676-c4f066c53dfd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.392889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.393547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.394948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.394948 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] PATH_INFO: `/v3/projects/13912c2d90c14ab0b1c45073c3986276/users/1aa594e362384bdbb4faf008495e7832/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.409146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=13912c2d90c14ab0b1c45073c3986276, user_id=1aa594e362384bdbb4faf008495e7832, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.411918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.488874 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1296/2552] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:13 2022] PUT /identity/v3/projects/13912c2d90c14ab0b1c45073c3986276/users/1aa594e362384bdbb4faf008495e7832/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:13.499448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.499836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.500115 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.522374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:13.532608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] MFA Rules not processed for user `1aa594e362384bdbb4faf008495e7832`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:13.533913 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:13.613844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1257/2553] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:13.626385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:13.628283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:13.672292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:13.686725 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d2820-57fb-4590-8bf4-cc0b80ef85ea admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:13.690355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:13.690986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:13.691267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:13.691569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:13.700488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:13.701918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:13.710934 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1297/2554] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:14.261963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:14.263460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:14.339436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c535a-25b1-4622-9ecd-5fb754eaa1d6 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:14.345365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:14.345742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:14.346021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:14.346374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:14.353910 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:14.417876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:14.419505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:14.429636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1258/2555] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:18.857526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:18.859012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:18.918675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52a7a-4444-4dbf-b1e5-23048ba9f8bf service glance] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:18.922603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:18.923405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:18.923720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:18.923999 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:18.925840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:18.995805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:18.997324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:19.007126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1298/2556] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:43:22.749459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:22.751036 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:22.767785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0be14-1c5c-4cae-99ed-ec9ec5897d33 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:22.776181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:22.776181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:22.776181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:22.776181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] PATH_INFO: `/v3/users/a0a1588ce02044c183ea0e2fea20e8e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:22.777104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a1588ce02044c183ea0e2fea20e8e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:22.779040 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:22.994334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:23.015194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a1588ce02044c183ea0e2fea20e8e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.016392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a1588ce02044c183ea0e2fea20e8e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.024056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a1588ce02044c183ea0e2fea20e8e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.038635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a1588ce02044c183ea0e2fea20e8e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.094122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c6e2d3a2-6f5a-4b47-b68f-1e605054d55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a1588ce02044c183ea0e2fea20e8e0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.100435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1259/2557] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:22 2022] DELETE /identity/v3/users/a0a1588ce02044c183ea0e2fea20e8e0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:23.378534 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:23.390976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f937c-8be4-4774-adc8-0e9a58a348e9 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:23.454022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:23.454724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:23.454951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:23.455230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] PATH_INFO: `/v3/projects/f78c790271514a5585db4efc1f691b2f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:23.456456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78c790271514a5585db4efc1f691b2f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:23.458394 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:23.555973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:23.567416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78c790271514a5585db4efc1f691b2f', 'request_id': 'req-566c9efd-348c-4781-b72c-da3fc1d91003'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.572996 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78c790271514a5585db4efc1f691b2f', 'request_id': 'req-566c9efd-348c-4781-b72c-da3fc1d91003'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.667506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78c790271514a5585db4efc1f691b2f', 'request_id': 'req-566c9efd-348c-4781-b72c-da3fc1d91003'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.680640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] The token cache is being invalidate because project f78c790271514a5585db4efc1f691b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:23.680932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.681591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-566c9efd-348c-4781-b72c-da3fc1d91003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:23.683224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1299/2558] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:23 2022] DELETE /identity/v3/projects/f78c790271514a5585db4efc1f691b2f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:23.688784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:23.689177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:23.689462 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:23.711000 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:23.712314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:23.776079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1260/2559] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:23.784527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:23.784813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:23.785118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:23.805008 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:23.809640 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:23.814861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1300/2560] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:23.819203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:23.829829 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1ce0f-7d19-4068-9d1c-3926eba016c4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:23.834389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:23.834995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:23.835277 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:23.835597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:23.836267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:23.836572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:23.838191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:23.850210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1261/2561] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:23.876464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:23.900937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86836f89-6c13-4816-9f38-05c0f87176ca None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:23.900937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:23.900937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:23.900937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:23.901444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:23.901444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:23.901444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:24.388899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1301/2562] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:23 2022] POST /identity/v3/projects => generated 373 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:24.393677 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:24.407626 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f963fa-4ccd-4087-8260-6563f3b324b2 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:24.469623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:24.470374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:24.470660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:24.470938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:24.471619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:24.473573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:24.568775 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1262/2563] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:24 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:24.572918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:24.583413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d71c-61cb-49b9-9792-242574f5c4d7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:24.588220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:24.588987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:24.589142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:24.589421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:24.590180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:24.591942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:24.602852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1302/2564] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:24.607603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:24.617615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ca5-ec42-4d83-98c9-c137cf56254c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:24.622857 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:24.623467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:24.623774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:24.624047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:24.624684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:24.626310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6a11-917c-4a90-9426-c3f150de26cb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:24.637472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1263/2565] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:24.641580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:24.652078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3e7-3e4e-4606-a395-b29fbaed9885 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:24.657004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:24.657707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:24.657943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:24.658221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] PATH_INFO: `/v3/projects/40e026aca62c4cfbb471a75d205a3a9d/users/cfd605fe46bc4fea931f9daf9d2f2c93/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:24.676612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e026aca62c4cfbb471a75d205a3a9d, user_id=cfd605fe46bc4fea931f9daf9d2f2c93, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:24.676748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:24.812634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1303/2566] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:24 2022] PUT /identity/v3/projects/40e026aca62c4cfbb471a75d205a3a9d/users/cfd605fe46bc4fea931f9daf9d2f2c93/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:24.823586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:24.824113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:24.824221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:24.852240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:24.855643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] MFA Rules not processed for user `cfd605fe46bc4fea931f9daf9d2f2c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:24.857871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:24.926937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1264/2567] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:24.939203 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:24.941035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:25.018480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c962b6-22b0-4e54-981e-5bd013b6570e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:25.024495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:25.025195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:25.025522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:25.025823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:25.034884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:25.036513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:25.045332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1304/2568] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:27.693248 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:27.694940 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:27.773916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657d95a-4a8a-4abc-b667-0f83af75666e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:27.779193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:27.779835 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:27.780120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:27.780396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:27.782134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:27.793797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:27.795373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:27.805455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1265/2569] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:27.845778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:27.847360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:27.899120 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:27.917852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11578-3cd7-43b9-b51a-0988ea936088 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:27.922712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:27.923476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:27.923894 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:27.924056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] PATH_INFO: `/v3/users/9b4327333bda4d19a686a1f42a764ccd` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:27.925245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4327333bda4d19a686a1f42a764ccd)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:27.927180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:28.127192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4327333bda4d19a686a1f42a764ccd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.134007 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4327333bda4d19a686a1f42a764ccd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.134673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4327333bda4d19a686a1f42a764ccd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.148920 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4327333bda4d19a686a1f42a764ccd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.149698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4327333bda4d19a686a1f42a764ccd'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.221796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1305/2570] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:27 2022] DELETE /identity/v3/users/9b4327333bda4d19a686a1f42a764ccd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:28.417217 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:28.429524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e248-5fa9-4a78-9468-12f3ef5160eb service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:28.490543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:28.491184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:28.491463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:28.491767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] PATH_INFO: `/v3/users/cfd605fe46bc4fea931f9daf9d2f2c93` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:28.492890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd605fe46bc4fea931f9daf9d2f2c93)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:28.495003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:28.504858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:28.505501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:28.542110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f42-b880-4d8d-b7e5-44203e4122ed admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:28.551986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:28.552823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:28.553107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:28.553382 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] PATH_INFO: `/v3/projects/c721e27f3cde4f7aafc564f25e9579d5` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:28.554529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c721e27f3cde4f7aafc564f25e9579d5)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:28.557152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:28.709230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c721e27f3cde4f7aafc564f25e9579d5', 'request_id': 'req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.715265 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c721e27f3cde4f7aafc564f25e9579d5', 'request_id': 'req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.804469 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c721e27f3cde4f7aafc564f25e9579d5', 'request_id': 'req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.809729 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:28.818304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] The token cache is being invalidate because project c721e27f3cde4f7aafc564f25e9579d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:28.822780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.822895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd605fe46bc4fea931f9daf9d2f2c93'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.823002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09bdff09-fc75-4d6d-98ab-9136a6c9aca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.823083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd605fe46bc4fea931f9daf9d2f2c93'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.823184 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1306/2571] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:28 2022] DELETE /identity/v3/projects/c721e27f3cde4f7aafc564f25e9579d5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:28.828265 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd605fe46bc4fea931f9daf9d2f2c93'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.846144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd605fe46bc4fea931f9daf9d2f2c93'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.924802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd605fe46bc4fea931f9daf9d2f2c93'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:28.932947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1266/2572] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:28 2022] DELETE /identity/v3/users/cfd605fe46bc4fea931f9daf9d2f2c93 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:28.937723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:28.938199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:28.938331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:28.959800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:28.961021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:29.008013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:29.026231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1307/2573] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:29.037162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:29.038585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:29.097674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc5f-1ae4-45ab-be05-0410b0f0a40a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:29.101191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:29.101792 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:29.102097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:29.102370 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:29.111634 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:29.113089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11103f76-218e-4a9f-b458-49e6874dc680 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:29.122317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1267/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:29.575198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:29.575198 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:29.610813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f275333-7492-4102-94bf-b7ce47eb50a9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:29.615880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:29.616579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:29.616861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:29.617180 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] PATH_INFO: `/v3/projects/40e026aca62c4cfbb471a75d205a3a9d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:29.618327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e026aca62c4cfbb471a75d205a3a9d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:29.620289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:29.724195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e026aca62c4cfbb471a75d205a3a9d', 'request_id': 'req-ecf00dba-77da-42a7-8e0e-65235083b848'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:29.729705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e026aca62c4cfbb471a75d205a3a9d', 'request_id': 'req-ecf00dba-77da-42a7-8e0e-65235083b848'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:29.799213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e026aca62c4cfbb471a75d205a3a9d', 'request_id': 'req-ecf00dba-77da-42a7-8e0e-65235083b848'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:29.811145 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] The token cache is being invalidate because project 40e026aca62c4cfbb471a75d205a3a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:29.811438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:29.812132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ecf00dba-77da-42a7-8e0e-65235083b848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:29.814418 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1308/2575] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:29 2022] DELETE /identity/v3/projects/40e026aca62c4cfbb471a75d205a3a9d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:29.826512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:29.826512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:29.826512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:29.839206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:29.840439 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:29.905242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1268/2576] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:29.914291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:29.914584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:29.914865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:29.935660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:29.936903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:29.945320 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1309/2577] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:29.949420 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:29.959845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a50fc6-6e13-424a-9859-202a07e9f3bb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:29.964466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:29.965095 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:29.965376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:29.965687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:29.966311 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:29.966615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:29.968238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:29.980863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1269/2578] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:29.985384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:29.994956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9bdaf-e1db-4d33-9965-9d186e5593af None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:29.999753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.000349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.000629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.001432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.002280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.004199 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.104562 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1310/2579] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:29 2022] POST /identity/v3/projects => generated 353 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:30.105822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.116301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf0ab-d3d7-437b-b9d2-ac1898005e72 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.158819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:30.175236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.175951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.176233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.176511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.177143 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.179084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.304019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1270/2580] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:30 2022] POST /identity/v3/users => generated 277 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:30.308140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.319156 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb4c81-fc8c-4b62-8f2b-c108c19a3413 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.323891 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.325430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.325430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.325430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.325735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.327376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.338423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1311/2581] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:30.342414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.353421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7028a5-b16b-4b26-b943-c710311fa5bf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.358392 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.359026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.359304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.359609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.360810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.362414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f68eea-76ab-4d16-91f4-43ed774a5fa1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.374485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1271/2582] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:30.379727 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.389976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be29f8-30d7-492d-8524-af60d959a81f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.394995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.400144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.400144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.400144 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] PATH_INFO: `/v3/projects/eb4e9b91e903420da04cf4de076d96de/users/4b65e72356554d8b8dd197c5249e5a1f/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.413077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4e9b91e903420da04cf4de076d96de, user_id=4b65e72356554d8b8dd197c5249e5a1f, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.415830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.483782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1312/2583] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:30 2022] PUT /identity/v3/projects/eb4e9b91e903420da04cf4de076d96de/users/4b65e72356554d8b8dd197c5249e5a1f/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:30.495013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.495301 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.495668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.524297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] MFA Rules not processed for user `4b65e72356554d8b8dd197c5249e5a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:30.525520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:30.593928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1272/2584] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:30.598549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.679292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2547e-aafa-4b55-8174-0a215b3c5ac5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.683960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.684561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.684842 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.685115 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.685739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.687652 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.698856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:30.786834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1313/2585] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:30 2022] POST /identity/v3/projects => generated 355 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:30.790997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.801978 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b038-7b5c-4133-92ad-1b98f75af4b3 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.856815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.857425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.857604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.857876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.858502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.860615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.942300 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1273/2586] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:30 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:30.946453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.958234 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd386a46-c2e5-415d-83f6-6295ec3b4a80 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.962882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.963510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.963827 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.964105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:30.964750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:30.966361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:30.976806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1314/2587] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:30.980926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:30.990990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258e75-af92-43c8-a3f7-10193d8a15c0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:30.995645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:30.996282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:30.996558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:30.996938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] PATH_INFO: `/v3/projects/0301ed6631f444009b0531ceb43d1c3f/users/557fb3ee639d43e6a1104fff03030554/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.013721 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0301ed6631f444009b0531ceb43d1c3f, user_id=557fb3ee639d43e6a1104fff03030554, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:31.016412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:31.095280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1274/2588] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:30 2022] PUT /identity/v3/projects/0301ed6631f444009b0531ceb43d1c3f/users/557fb3ee639d43e6a1104fff03030554/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:31.099259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:31.109193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d64f8-18ee-4908-944e-bce2b7ed5270 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:31.165083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:31.165662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:31.165941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:31.166213 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.166843 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:31.168480 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee285-256a-4cb3-b020-346d5b59d2a3 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:31.178818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1315/2589] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:31.182926 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:31.194004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68a55-9323-4ff4-be60-5f3868b5accb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:31.198544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:31.199194 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:31.199475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:31.199777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] PATH_INFO: `/v3/projects/0301ed6631f444009b0531ceb43d1c3f/users/557fb3ee639d43e6a1104fff03030554/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.201709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0301ed6631f444009b0531ceb43d1c3f, user_id=557fb3ee639d43e6a1104fff03030554, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:31.204707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:31.214666 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1275/2590] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:31 2022] PUT /identity/v3/projects/0301ed6631f444009b0531ceb43d1c3f/users/557fb3ee639d43e6a1104fff03030554/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:31.224847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:31.225126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:31.225403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.254038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] MFA Rules not processed for user `557fb3ee639d43e6a1104fff03030554`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:31.255253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:31.321507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1316/2591] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:31.332922 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:31.334722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:31.340005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:31.393842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e72f3c-85ed-4cf3-a059-55ac4541f0eb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:31.397686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:31.398287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:31.398584 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:31.398863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.408013 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:31.409577 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:31.419262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1276/2592] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:31.595703 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:31.605831 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4f98-bde6-4c86-8ee1-c23527965446 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:31.609576 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:31.610249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:31.610713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:31.611010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:31.668494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:31.670186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:31.675588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:31.681444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1317/2593] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:40.253596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:40.255160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:40.322428 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2b05-5f11-49fb-b262-2aae88c45831 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:40.326587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:40.327213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:40.327525 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:40.327811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:40.329604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:40.405423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:40.405423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:40.414256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1277/2594] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:43:44.147730 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:44.149196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.163055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85a70-10b5-4e11-b486-9d139888b364 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:44.167622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:44.168275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:44.168558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:44.168836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] PATH_INFO: `/v3/users/1aa594e362384bdbb4faf008495e7832` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:44.169979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa594e362384bdbb4faf008495e7832)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:44.171931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:44.239427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:44.241159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.257155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6653f3-bafa-477f-b883-ee25d991afeb service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:44.262321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:44.263009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:44.263292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:44.263613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] PATH_INFO: `/v3/users/01e09dde19114205bc3a73aab9e8cbbd` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:44.264783 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e09dde19114205bc3a73aab9e8cbbd)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:44.266781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:44.349990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa594e362384bdbb4faf008495e7832'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.357966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa594e362384bdbb4faf008495e7832'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.358692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa594e362384bdbb4faf008495e7832'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.372916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa594e362384bdbb4faf008495e7832'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.373633 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8cf4ebd5-406a-444f-a152-2689163c3d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa594e362384bdbb4faf008495e7832'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.463368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e09dde19114205bc3a73aab9e8cbbd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.464044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e09dde19114205bc3a73aab9e8cbbd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.466009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:44.471818 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e09dde19114205bc3a73aab9e8cbbd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.493646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1318/2595] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:44 2022] DELETE /identity/v3/users/1aa594e362384bdbb4faf008495e7832 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:44.493954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e09dde19114205bc3a73aab9e8cbbd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.494054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:44.494054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:44.494054 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:44.508679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:44.509880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.569985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1319/2596] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:44.579599 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:44.581613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.625104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e09dde19114205bc3a73aab9e8cbbd'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:44.635209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1278/2597] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:44 2022] DELETE /identity/v3/users/01e09dde19114205bc3a73aab9e8cbbd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:44.642194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8baa60-3b07-4764-8cb8-02349c57ef34 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:44.674668 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:44.704027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:44.704027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:44.704027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:44.704027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:44.704452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.765528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:44.766971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e5f3c-4e22-4382-85e4-b9ab8a61171c service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:44.778570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1320/2598] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:43:44.920882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:44.922457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:44.936102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23d78-5a2e-4f44-b88a-aa87bdd7045c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:44.941222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:44.941851 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:44.942131 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:44.942413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] PATH_INFO: `/v3/projects/cec80e12d95b4ea4939c57abc8393d93` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:44.945490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec80e12d95b4ea4939c57abc8393d93)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:44.945490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.057592 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec80e12d95b4ea4939c57abc8393d93', 'request_id': 'req-9922424b-2932-4471-af25-9ca8415653e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.063574 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec80e12d95b4ea4939c57abc8393d93', 'request_id': 'req-9922424b-2932-4471-af25-9ca8415653e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.147168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec80e12d95b4ea4939c57abc8393d93', 'request_id': 'req-9922424b-2932-4471-af25-9ca8415653e1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.160580 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] The token cache is being invalidate because project cec80e12d95b4ea4939c57abc8393d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:45.161078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.161756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-9922424b-2932-4471-af25-9ca8415653e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.167223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1279/2599] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:44 2022] DELETE /identity/v3/projects/cec80e12d95b4ea4939c57abc8393d93 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:45.169013 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.170133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.170610 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.200001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:45.201249 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.284454 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1321/2600] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:45.292367 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.301960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.301960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.332732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:45.333966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.342372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1280/2601] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:45.347056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.357341 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ad15-cc33-4ea5-a6ae-ce5a02458ca5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.362421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.363025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.363303 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.363616 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.364262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:45.364564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.366168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.378549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1322/2602] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:45.383331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.393683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d26d-1c4d-4955-9e35-9fabf67e1461 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.398697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.399294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.399613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.399891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.400526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.402526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.438918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.441403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.457360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38fd5-39bc-4bc8-813d-2701c05ef146 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.462728 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.463568 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.463856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.464196 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] PATH_INFO: `/v3/projects/13912c2d90c14ab0b1c45073c3986276` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.465393 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=13912c2d90c14ab0b1c45073c3986276)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.467287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.525682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1281/2603] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:45.529762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.589486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13912c2d90c14ab0b1c45073c3986276', 'request_id': 'req-bcbd765d-52ee-41d1-b8ac-669893e7adaf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.595569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13912c2d90c14ab0b1c45073c3986276', 'request_id': 'req-bcbd765d-52ee-41d1-b8ac-669893e7adaf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.598232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:45.690106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13912c2d90c14ab0b1c45073c3986276', 'request_id': 'req-bcbd765d-52ee-41d1-b8ac-669893e7adaf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.703149 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] The token cache is being invalidate because project 13912c2d90c14ab0b1c45073c3986276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:45.703446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.704152 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-bcbd765d-52ee-41d1-b8ac-669893e7adaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:45.706498 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1323/2604] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:45 2022] DELETE /identity/v3/projects/13912c2d90c14ab0b1c45073c3986276 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:45.711194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b2f1-2b7b-4f89-bd69-7ad38542a0f8 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.711508 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b2f1-2b7b-4f89-bd69-7ad38542a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.711794 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b2f1-2b7b-4f89-bd69-7ad38542a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.719221 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ef29-0c74-47ba-a1b5-56a31739cea0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.732076 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c153b2f1-2b7b-4f89-bd69-7ad38542a0f8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:45.733295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c153b2f1-2b7b-4f89-bd69-7ad38542a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.746144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:45.777118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.777676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.777955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.778233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.778872 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.781011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.796670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1324/2605] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:45.804490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.804784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.805065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.824168 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:45.825490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.834247 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1325/2606] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:45.838117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.847926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2899e6-f4ba-49ff-8792-5bef755439d9 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.852612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.853192 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.853479 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.853844 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.854561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:45.854872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.856514 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.867910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1326/2607] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:43:45.871995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.881421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60031db-4f0e-4723-ad17-7c08e3648d7f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.887754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.893986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.893986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.893986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.893986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.894328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1282/2608] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:45.894429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.897313 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.898982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:45.911298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a4c74-058d-4953-9342-8fc4f128afbd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.916201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.916806 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.917091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.917365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.918012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.919727 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.930327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1283/2609] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:45.934157 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.943461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c0da-f85d-4e5a-9e2b-376ee38eaf1e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.948328 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.948908 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.949191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.949465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.950121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:45.951740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:45.962069 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1284/2610] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:45.967377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:45.977915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739725f4-7947-4bb3-84f7-e83c9beb4430 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:45.982503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:45.983137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:45.983414 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:45.983718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] PATH_INFO: `/v3/projects/e4ba81949826494a9dbab20454379469/users/e01c39e0b8cb4fe9a0faa726c7c82692/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:45.997987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ba81949826494a9dbab20454379469, user_id=e01c39e0b8cb4fe9a0faa726c7c82692, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.000678 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceebc6-971b-4c58-9a86-4b5974bb2ca0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.069305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1327/2611] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:45 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:46.077876 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1285/2612] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:45 2022] PUT /identity/v3/projects/e4ba81949826494a9dbab20454379469/users/e01c39e0b8cb4fe9a0faa726c7c82692/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:46.080314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.089781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.090070 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.090351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.121120 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] MFA Rules not processed for user `e01c39e0b8cb4fe9a0faa726c7c82692`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:46.122322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:46.157451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3fab-32e8-4882-aeaa-563e8f8e6fba admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.198995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1286/2613] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:46.213117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.214523 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:46.223127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.224490 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.224868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.225277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.226082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.228364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.272855 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2ea3d-9a76-4056-b51a-b7da09ccf59d None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.276624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.277232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.277508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.277777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.287256 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.288388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.297206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1287/2614] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:43:46.323099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1328/2615] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:46 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:46.324057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.334593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d3d6f-f650-4f00-b0f9-845d7acbe526 service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.339245 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.339874 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.340192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.340491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.341168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.342745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.346271 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:46.363668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1288/2616] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:46.365745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.376664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cf823-69a6-4bfa-9e2f-bb6e1a946c99 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.383881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.384625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.384971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.385255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.385912 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.386605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:46.387706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20f32-0b41-4857-a076-e1bac1afee66 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.403176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1329/2617] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:46.404461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.415718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab0904-f44c-480e-a9dd-c66d14901d55 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.421212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.422093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.422375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.422652 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] PATH_INFO: `/v3/projects/a40b71d886c340348ec8474eeaa618af/users/ab442febdd434a399f1954668fd75a93/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.447718 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40b71d886c340348ec8474eeaa618af, user_id=ab442febdd434a399f1954668fd75a93, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.450484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.541164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1289/2618] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:46 2022] PUT /identity/v3/projects/a40b71d886c340348ec8474eeaa618af/users/ab442febdd434a399f1954668fd75a93/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:46.553557 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.553865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.554122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.592186 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] MFA Rules not processed for user `ab442febdd434a399f1954668fd75a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:46.593467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:46.659021 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1330/2619] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:46.719968 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.723177 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:46.787959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042200b-f487-41c2-88f8-ab9e660eeef4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.792513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.793117 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.793396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.793668 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.802893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.804366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad1dab-aa8d-478a-952c-3d5eca4a4fc5 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:46.813368 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1290/2620] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:46.848279 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:46.918503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096b5e9-7b62-49fa-ab42-aa0a2987b98c None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:46.924095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:46.925375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:46.925658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:46.925932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] PATH_INFO: `/v3/users/ab442febdd434a399f1954668fd75a93` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:46.927124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab442febdd434a399f1954668fd75a93)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:46.929188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:47.176951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab442febdd434a399f1954668fd75a93'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:47.186002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab442febdd434a399f1954668fd75a93'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:47.187462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab442febdd434a399f1954668fd75a93'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:47.199128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:47.207223 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab442febdd434a399f1954668fd75a93'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:47.208357 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab442febdd434a399f1954668fd75a93'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:47.323571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1331/2621] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:46 2022] DELETE /identity/v3/users/ab442febdd434a399f1954668fd75a93 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:47.324928 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:47.327705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:47.327705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:47.349039 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:47.350213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:47.416269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1291/2622] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:47.427121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:47.428596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:47.504732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa020ab-6868-4731-abbe-ce69431bbd31 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:47.510778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:47.510778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:47.510778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:47.511445 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:47.522374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:47.523991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:47.540741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1332/2623] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:47.990620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:47.993234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:48.006907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d5a9-e5d0-4d4c-b724-7ddcb548fe51 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:48.011843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:48.012667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:48.013351 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:48.014074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] PATH_INFO: `/v3/projects/a40b71d886c340348ec8474eeaa618af` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:48.015954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40b71d886c340348ec8474eeaa618af)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:48.018836 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:48.155139 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40b71d886c340348ec8474eeaa618af', 'request_id': 'req-59345a03-2b1b-45f2-b4cc-497dad82c2f8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:48.165579 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40b71d886c340348ec8474eeaa618af', 'request_id': 'req-59345a03-2b1b-45f2-b4cc-497dad82c2f8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:48.243557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40b71d886c340348ec8474eeaa618af', 'request_id': 'req-59345a03-2b1b-45f2-b4cc-497dad82c2f8'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:48.246995 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:48.257324 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] The token cache is being invalidate because project a40b71d886c340348ec8474eeaa618af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:48.257773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:48.258317 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-59345a03-2b1b-45f2-b4cc-497dad82c2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:48.260164 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1292/2624] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:47 2022] DELETE /identity/v3/projects/a40b71d886c340348ec8474eeaa618af => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:51.379646 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:51.381091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:51.394631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6a7f-866b-4435-8ad1-3f0c39fb8c3e service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:51.451105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:51.451771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:51.452055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:51.452332 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] PATH_INFO: `/v3/users/4b65e72356554d8b8dd197c5249e5a1f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:51.453547 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b65e72356554d8b8dd197c5249e5a1f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:51.456206 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:51.634496 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b65e72356554d8b8dd197c5249e5a1f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:51.641532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b65e72356554d8b8dd197c5249e5a1f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:51.642185 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b65e72356554d8b8dd197c5249e5a1f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:51.655087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b65e72356554d8b8dd197c5249e5a1f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:51.657468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b65e72356554d8b8dd197c5249e5a1f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:51.727535 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1333/2625] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:51 2022] DELETE /identity/v3/users/4b65e72356554d8b8dd197c5249e5a1f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:51.732282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:51.732761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:51.732882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:51.752976 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:51.754192 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:51.814038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1293/2626] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:51.827507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:51.828527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:51.835980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:51.889523 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4c7de-4ae2-433d-8251-1f0facbb7803 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:51.893782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:51.894409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:51.894672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:51.894941 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:51.904630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:51.909093 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:51.916583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1334/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:52.388798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:52.390507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:52.413427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c49f8-bace-4949-997e-b23d1e7fbf2c None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:52.421517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:52.422171 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:52.422452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:52.422759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] PATH_INFO: `/v3/projects/eb4e9b91e903420da04cf4de076d96de` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:52.424896 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4e9b91e903420da04cf4de076d96de)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:52.427029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:52.560794 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4e9b91e903420da04cf4de076d96de', 'request_id': 'req-396ff7d8-83c3-4f72-9095-f098ee419563'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.567509 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4e9b91e903420da04cf4de076d96de', 'request_id': 'req-396ff7d8-83c3-4f72-9095-f098ee419563'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.683671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4e9b91e903420da04cf4de076d96de', 'request_id': 'req-396ff7d8-83c3-4f72-9095-f098ee419563'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.696707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] The token cache is being invalidate because project eb4e9b91e903420da04cf4de076d96de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:52.696707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.696974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.698379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1294/2628] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:52 2022] DELETE /identity/v3/projects/eb4e9b91e903420da04cf4de076d96de => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:52.702383 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:52.713395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974222-7778-45dc-ba4e-2b8b3cac7bef service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:52.771374 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:52.772294 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:52.772579 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:52.772902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] PATH_INFO: `/v3/users/557fb3ee639d43e6a1104fff03030554` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:52.774028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557fb3ee639d43e6a1104fff03030554)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:52.775978 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:52.984780 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557fb3ee639d43e6a1104fff03030554'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.993928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557fb3ee639d43e6a1104fff03030554'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:52.994636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557fb3ee639d43e6a1104fff03030554'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.008724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557fb3ee639d43e6a1104fff03030554'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.013559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557fb3ee639d43e6a1104fff03030554'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.147324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1335/2629] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:52 2022] DELETE /identity/v3/users/557fb3ee639d43e6a1104fff03030554 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:53.400430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:53.402006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:53.461607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff7d8-83c3-4f72-9095-f098ee419563 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:53.494381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:53.511296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:53.511935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:53.512222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:53.512502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:53.514271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:53.564910 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:53.568269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:53.588258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:53.590637 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ae41d-a269-490d-ad00-94480cdcf651 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:53.601412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1295/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:53.605262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:53.647403 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b4f5-c780-4f44-998d-8070180ec3d0 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:53.651995 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:53.652625 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:53.652904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:53.653250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] PATH_INFO: `/v3/projects/0301ed6631f444009b0531ceb43d1c3f` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:53.654533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0301ed6631f444009b0531ceb43d1c3f)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:53.656532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:53.793690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0301ed6631f444009b0531ceb43d1c3f', 'request_id': 'req-f6764f38-a9e7-48c6-9731-75249bb419e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.799291 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0301ed6631f444009b0531ceb43d1c3f', 'request_id': 'req-f6764f38-a9e7-48c6-9731-75249bb419e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.877904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0301ed6631f444009b0531ceb43d1c3f', 'request_id': 'req-f6764f38-a9e7-48c6-9731-75249bb419e5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.891219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] The token cache is being invalidate because project 0301ed6631f444009b0531ceb43d1c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:53.891785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.892455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f6764f38-a9e7-48c6-9731-75249bb419e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:53.894590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1336/2631] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:53 2022] DELETE /identity/v3/projects/0301ed6631f444009b0531ceb43d1c3f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:53.900080 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:53.900443 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:53.900807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:53.921571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:53.925306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:53.985402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1296/2632] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:53.993381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:53.993666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:53.993944 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.016107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:54.017597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:54.028068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1337/2633] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:54.034537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.045286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1a37-0d59-4a37-b680-fc2c7602afda None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.050201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.050882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.051533 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.051879 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.052670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:54.053223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.054958 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.072493 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1297/2634] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:43:54.073515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.084719 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeea4f-9ca8-493f-bd3a-f81d6b71f9dc None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.090075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.090753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.091107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.091621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.092456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.094650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.181712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1338/2635] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:54 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:54.185705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.198487 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2067-1bf7-4008-960e-2294156c5f8d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.267707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.268332 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.268615 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.269067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.270748 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.275973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.370854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1298/2636] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:54 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:54.375020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.386521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca22e1-ea91-4c38-bf52-ecb90b6c0d99 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.391321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.392015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.392304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.392582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.393226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.394867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.408219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1339/2637] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:54.413897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.419290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:54.424645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc6486-941c-4ef4-b7b2-8505c16ef66a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.429732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.430532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.430815 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.431267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.431956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.433871 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a52e-000a-4a7a-a736-08e87cea564e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.445605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1299/2638] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:54.449833 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.460622 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72359b1-854a-4210-872c-d1d02b1f2339 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.465354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.466005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.466285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.466555 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] PATH_INFO: `/v3/projects/78e84177b5fa4902b2a5ccb255a8daa9/users/b6e1df7051bc48d2b2f241528d774995/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.483655 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e84177b5fa4902b2a5ccb255a8daa9, user_id=b6e1df7051bc48d2b2f241528d774995, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.488025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:54.589801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1340/2639] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:54 2022] PUT /identity/v3/projects/78e84177b5fa4902b2a5ccb255a8daa9/users/b6e1df7051bc48d2b2f241528d774995/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:54.600695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.601024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.601252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.637255 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] MFA Rules not processed for user `b6e1df7051bc48d2b2f241528d774995`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:54.638502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:54.712366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1300/2640] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:54.717015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:54.780121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:54.791922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217d42-1211-443c-9d24-f443d4383d47 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:54.796644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:54.797241 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:54.797528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:54.797924 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:54.798574 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:54.800519 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.191126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1341/2641] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:54 2022] POST /identity/v3/projects => generated 387 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:55.196755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.216576 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75603b6-fafe-4400-8b5e-554f08875293 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.293819 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.294551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.294927 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.295298 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.296063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.298118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.393108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1301/2642] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:55 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:55.397348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.407692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a6e3-1e96-4076-8fcd-c3fca2ec59fa admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.414428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.415128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.415525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.415849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.416567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.418275 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.430296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1342/2643] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:43:55.434289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.447534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b784a4-afad-4739-8b9c-536ccf23da46 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.452804 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.453645 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.453777 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.454014 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] PATH_INFO: `/v3/projects/5be8165cecae42dfbad026aefcdea272/users/6836c27d47ac42f6a0b83e4b3fa46bc7/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.469859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be8165cecae42dfbad026aefcdea272, user_id=6836c27d47ac42f6a0b83e4b3fa46bc7, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.472549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.585402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1302/2644] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:55 2022] PUT /identity/v3/projects/5be8165cecae42dfbad026aefcdea272/users/6836c27d47ac42f6a0b83e4b3fa46bc7/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:55.589080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.599724 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba88ad-08df-4451-92a2-4d288935bd73 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.661939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.662650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.663002 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.663322 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.664094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.666858 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d234e97-1fb3-41f3-b943-1058e64d6632 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.679803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1343/2645] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:55.683790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.696116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48333467-2526-4dc9-971b-8ac9db74546e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.702096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.702764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.703050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.703331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] PATH_INFO: `/v3/projects/5be8165cecae42dfbad026aefcdea272/users/6836c27d47ac42f6a0b83e4b3fa46bc7/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.705531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be8165cecae42dfbad026aefcdea272, user_id=6836c27d47ac42f6a0b83e4b3fa46bc7, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.708463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.719538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1303/2646] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:55 2022] PUT /identity/v3/projects/5be8165cecae42dfbad026aefcdea272/users/6836c27d47ac42f6a0b83e4b3fa46bc7/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:55.731476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.731801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.732085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.761559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] MFA Rules not processed for user `6836c27d47ac42f6a0b83e4b3fa46bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:55.762933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:55.836566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1344/2647] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:55.847680 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:55.851118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:55.888596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:55.913307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7b2a3-a772-461a-923a-de6ec3ac09b6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:55.917061 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:55.917751 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:55.918026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:55.918294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:55.927998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:55.929419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8b8c-ce99-4c49-a78f-48d97e529d8d service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:55.938890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1304/2648] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:56.006747 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:56.068771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:56.089321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04027-6ce5-46b6-9886-0c915425c2dd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:56.091993 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:56.092669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:56.092960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:56.093364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] PATH_INFO: `/v3/users/b6e1df7051bc48d2b2f241528d774995` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:56.094590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e1df7051bc48d2b2f241528d774995)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:56.096677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:56.275452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e1df7051bc48d2b2f241528d774995'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.283001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e1df7051bc48d2b2f241528d774995'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.283962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e1df7051bc48d2b2f241528d774995'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.298564 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e1df7051bc48d2b2f241528d774995'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.299285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e1df7051bc48d2b2f241528d774995'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.345698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1345/2649] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:56 2022] DELETE /identity/v3/users/b6e1df7051bc48d2b2f241528d774995 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:56.350739 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:56.351028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:56.351307 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:56.370202 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:56.371427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:56.444559 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1305/2650] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:56.484020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:56.486392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:56.576871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fd7d6-5f72-4e4d-bf85-9c67f47e697d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:56.586545 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:56.587183 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:56.587466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:56.587932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:56.601026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:56.602856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f079f-80a3-4f53-ada4-19ab7e30daf0 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:56.609447 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:56.610988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:56.620540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1346/2651] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:56.629780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bd2a-3b84-4be7-8cf8-cd40d73635b8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:56.635585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:56.636241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:56.636524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:56.636801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] PATH_INFO: `/v3/users/e01c39e0b8cb4fe9a0faa726c7c82692` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:56.638101 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01c39e0b8cb4fe9a0faa726c7c82692)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:56.640046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:56.914028 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01c39e0b8cb4fe9a0faa726c7c82692'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.914838 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01c39e0b8cb4fe9a0faa726c7c82692'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.925229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01c39e0b8cb4fe9a0faa726c7c82692'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:56.940890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01c39e0b8cb4fe9a0faa726c7c82692'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.038737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01c39e0b8cb4fe9a0faa726c7c82692'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.050162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1306/2652] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:56 2022] DELETE /identity/v3/users/e01c39e0b8cb4fe9a0faa726c7c82692 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:57.054607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:57.055106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:57.055211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:57.076752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:57.077994 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:57.147459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1347/2653] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:57.153974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:57.155500 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:57.188056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:57.189890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:57.213716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fd62a-93c3-44b5-9aec-ec957c5abc6b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:57.219928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:57.220973 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:57.221402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:57.221715 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] PATH_INFO: `/v3/projects/78e84177b5fa4902b2a5ccb255a8daa9` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:57.223591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e84177b5fa4902b2a5ccb255a8daa9)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:57.225283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:57.226238 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:57.229640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc46-6899-45d8-903a-153bceb32951 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:57.234540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:57.235293 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:57.235423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:57.235725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:57.236673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:57.250005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:57.251587 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:57.263386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1307/2654] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:43:57.309899 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:57.312475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:57.332038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65df767-1c65-4f54-9447-1801b6b46656 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:57.337035 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:57.337833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:57.338209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:57.338588 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] PATH_INFO: `/v3/users/c6ed88668fa04f3f8b423af40e240557` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:57.340316 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ed88668fa04f3f8b423af40e240557)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:57.342459 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:57.373219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e84177b5fa4902b2a5ccb255a8daa9', 'request_id': 'req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.383264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e84177b5fa4902b2a5ccb255a8daa9', 'request_id': 'req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.516497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e84177b5fa4902b2a5ccb255a8daa9', 'request_id': 'req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.529591 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] The token cache is being invalidate because project 78e84177b5fa4902b2a5ccb255a8daa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:57.529878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.530549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.532073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1348/2655] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:57 2022] DELETE /identity/v3/projects/78e84177b5fa4902b2a5ccb255a8daa9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:57.536634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:57.538376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:57.594252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ed88668fa04f3f8b423af40e240557'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.594713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ed88668fa04f3f8b423af40e240557'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.602982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ed88668fa04f3f8b423af40e240557'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.616701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ed88668fa04f3f8b423af40e240557'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.633407 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef757e-7ff3-436a-9d9b-211c8c5ce65c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:57.638280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:57.643125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:57.643405 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:57.643695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] PATH_INFO: `/v3/users/6836c27d47ac42f6a0b83e4b3fa46bc7` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:57.645475 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6836c27d47ac42f6a0b83e4b3fa46bc7)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:57.650037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:57.683122 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ed88668fa04f3f8b423af40e240557'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:57.689435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1308/2656] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:57 2022] DELETE /identity/v3/users/c6ed88668fa04f3f8b423af40e240557 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:58.046292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.047774 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.054487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6836c27d47ac42f6a0b83e4b3fa46bc7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.062643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6836c27d47ac42f6a0b83e4b3fa46bc7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.063165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6836c27d47ac42f6a0b83e4b3fa46bc7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.084269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6836c27d47ac42f6a0b83e4b3fa46bc7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.084269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6836c27d47ac42f6a0b83e4b3fa46bc7'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.132753 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8f2a-7947-46ba-8ab7-f8f5e1db65ba admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.137531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.138166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.142646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.142646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] PATH_INFO: `/v3/projects/bf6982e156e846f7adfe00fbda7418e0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.142646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6982e156e846f7adfe00fbda7418e0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.142646 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.163339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1349/2657] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:43:57 2022] DELETE /identity/v3/users/6836c27d47ac42f6a0b83e4b3fa46bc7 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:43:58.166605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.166605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.232776 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36e053-e31b-442c-8c48-9d6562d18e49 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.237865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.238517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.238782 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.239040 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] PATH_INFO: `/v3/projects/e4ba81949826494a9dbab20454379469` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.240328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ba81949826494a9dbab20454379469)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.242399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.264423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6982e156e846f7adfe00fbda7418e0', 'request_id': 'req-c4e962c5-2326-4aea-b235-1a6d5288563c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.270650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6982e156e846f7adfe00fbda7418e0', 'request_id': 'req-c4e962c5-2326-4aea-b235-1a6d5288563c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.363228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6982e156e846f7adfe00fbda7418e0', 'request_id': 'req-c4e962c5-2326-4aea-b235-1a6d5288563c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.364967 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:58.365620 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:58.378494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] The token cache is being invalidate because project bf6982e156e846f7adfe00fbda7418e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:58.378723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.380403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c4e962c5-2326-4aea-b235-1a6d5288563c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.382031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1309/2658] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:58 2022] DELETE /identity/v3/projects/bf6982e156e846f7adfe00fbda7418e0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:58.387024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0c19-5c2c-4409-953a-caf5c40d8959 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.387306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0c19-5c2c-4409-953a-caf5c40d8959 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.387994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0c19-5c2c-4409-953a-caf5c40d8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.397318 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ba81949826494a9dbab20454379469', 'request_id': 'req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.404220 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ba81949826494a9dbab20454379469', 'request_id': 'req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.412535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3f5e0c19-5c2c-4409-953a-caf5c40d8959 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:58.413839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3f5e0c19-5c2c-4409-953a-caf5c40d8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.481539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1310/2659] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:58.481767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ba81949826494a9dbab20454379469', 'request_id': 'req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.483361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.483682 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.483963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.493227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] The token cache is being invalidate because project e4ba81949826494a9dbab20454379469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:58.493550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.494124 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ae1510cb-a527-49f4-acdd-cd325a5d3b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.495856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1350/2660] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:58 2022] DELETE /identity/v3/projects/e4ba81949826494a9dbab20454379469 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:58.502378 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe133a1-b1e6-44fd-ac93-7dfe90030121 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.502686 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe133a1-b1e6-44fd-ac93-7dfe90030121 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.502950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe133a1-b1e6-44fd-ac93-7dfe90030121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.514078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:58.515965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.523078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-3fe133a1-b1e6-44fd-ac93-7dfe90030121 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:58.524305 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3fe133a1-b1e6-44fd-ac93-7dfe90030121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.524781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1311/2661] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:58.529346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.532263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1351/2662] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:58.540321 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9264af-437f-42e1-a8b2-72466bad0a59 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.541022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.548682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.548682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.548885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.548885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.548885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.548885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.549219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:58.549219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.549219 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.560526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1312/2663] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:43:58.561748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:58.562960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.564827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.571677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1352/2664] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:43:58.574558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe201f-d132-48e1-916c-712db06a00f0 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.579239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.579843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.580156 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.580312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.580423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.581029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.583511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.590396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a3c4-8057-4171-ac65-e08a5db92ed6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.595459 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.596176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.596465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.596744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.597397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:58.597707 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.600066 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.612674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1353/2665] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:43:58.613909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.615851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.628915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1c4ca-a0e2-4c47-b5f7-b1564cc2b0e6 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.634023 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.634740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.634922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.635189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] PATH_INFO: `/v3/projects/5be8165cecae42dfbad026aefcdea272` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.636569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be8165cecae42dfbad026aefcdea272)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.638416 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.683745 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1313/2666] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:43:58.684691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.745986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e542-19a5-45e0-a398-0efee75e4eb7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.750759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.751361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.751681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.751967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.752617 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.755125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.787444 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be8165cecae42dfbad026aefcdea272', 'request_id': 'req-29bae540-d70f-4fc7-9c3a-308a6da0fa76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.792869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be8165cecae42dfbad026aefcdea272', 'request_id': 'req-29bae540-d70f-4fc7-9c3a-308a6da0fa76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.861405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1314/2667] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:58.862203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.867396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be8165cecae42dfbad026aefcdea272', 'request_id': 'req-29bae540-d70f-4fc7-9c3a-308a6da0fa76'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.880105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] The token cache is being invalidate because project 5be8165cecae42dfbad026aefcdea272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:43:58.880503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.881232 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:43:58.882840 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1354/2668] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:43:58 2022] DELETE /identity/v3/projects/5be8165cecae42dfbad026aefcdea272 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:58.887110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:58.887110 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:58.932152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7fa9a-568a-4810-b8f7-52a1be0238c8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.936875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.937480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.937761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.938290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.938717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.941155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c06bc-669e-40f8-9c69-63c6c84bc683 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.952907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae540-d70f-4fc7-9c3a-308a6da0fa76 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:58.958766 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:58.959430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.959761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.960031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:58.960650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:58.962552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:58.997699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1315/2669] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/users => generated 282 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:58.998938 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:58.999246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:58.999522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.019074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:59.020670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:59.028784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1316/2670] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:59.029604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.030809 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:59.042942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7e64-1dbe-4d52-8179-624edf1a1db1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.047603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.048184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.048463 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.048737 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.049371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.051011 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d75e8-159f-4332-bdda-fd55a88ee741 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.061146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1355/2671] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:58 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.064687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1317/2672] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.064687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.064687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.064687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.066028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.076126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc372-4a47-4ad8-a4c8-1956c437c31d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.081099 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.085026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.085026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.085026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.085026 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.085476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:59.085476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:59.085670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.093470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1318/2673] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:59.094297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.097048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1356/2674] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.102324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.106393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267baa9-8679-4a81-bb51-edf9a5fc244a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.108421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93bd1-f5ad-44f4-9c2c-0c5ce0e6e654 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.111432 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.112238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.113636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:59.114321 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.114971 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.115103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.115269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.115408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.119657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.119784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.119880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:43:59.119880 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.120021 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.120107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.128135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1319/2675] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.128947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.130176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:59.133660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1357/2676] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:43:59.133660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.140352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712bc5-1cc3-4bbc-b948-c5880a1979c6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.143643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945411c4-ebcd-4eec-9c28-3ebe267a5e9f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.144647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.146045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.146749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.147038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.147712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.149299 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.149654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.150330 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.150784 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.151060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] PATH_INFO: `/v3/projects/c76f151620d143cba5fb27bf6b919769/users/8456918c4a9f4a1abd04b9342ef17ec1/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.159268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1320/2677] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.160121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.168140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76f151620d143cba5fb27bf6b919769, user_id=8456918c4a9f4a1abd04b9342ef17ec1, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.170538 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07b77-3069-4916-9514-83f4b5dc3877 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.170850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.175119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.175724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.176006 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.176356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.177303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.179173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21740-1731-46d4-8173-cb1ea9d4fed4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.249354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1358/2678] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:59 2022] PUT /identity/v3/projects/c76f151620d143cba5fb27bf6b919769/users/8456918c4a9f4a1abd04b9342ef17ec1/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:59.250905 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.280657 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1321/2679] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.287374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.287374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.287374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.309176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] MFA Rules not processed for user `8456918c4a9f4a1abd04b9342ef17ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:59.310442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:59.315862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114ba5-62ce-47f8-a0da-e005dfd7f878 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.377743 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.377961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1322/2680] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:59.378409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.378691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.378965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] PATH_INFO: `/v3/projects/635319d08650407c8e8ee28c8daab6c6/users/db51127b9f944ca781872a01794eda67/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.381142 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.392452 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a507-572c-4f90-b370-c4ca0c80e1eb None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.394670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=635319d08650407c8e8ee28c8daab6c6, user_id=db51127b9f944ca781872a01794eda67, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.398590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.398714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.399211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.399502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.399801 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.400426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.402594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.470997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1359/2681] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:59 2022] PUT /identity/v3/projects/635319d08650407c8e8ee28c8daab6c6/users/db51127b9f944ca781872a01794eda67/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:43:59.472619 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.481640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1323/2682] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.482671 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.492776 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a0952-fd4f-479d-bd63-b997f0d5eacc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.523478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:59.540061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158e55-3c54-4596-9fe4-0052d294f64c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.544865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.545474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.545760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.546038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.546672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.548675 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.552160 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.552764 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.553162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.553498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.554147 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.555780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ae416-fb96-4b4b-a409-7b8a123c676e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.565676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1324/2683] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.567398 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.567873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.568128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.579739 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:59.594476 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] MFA Rules not processed for user `db51127b9f944ca781872a01794eda67`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:43:59.595720 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:43:59.658375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1325/2684] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:43:59.659108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.669860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91869b-4fbf-4b19-9c19-80c4ec5abf18 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.674489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.675113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.675390 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.675725 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.676375 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.677962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.684872 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1360/2685] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.685697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.688573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1326/2686] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.690103 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.700688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585d39-2330-460c-ac7d-a64dfa63b3b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.750020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89f0c-7862-49ff-9a1e-aef3f9acfedf admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.755628 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.755930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.756256 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.756539 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.756667 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.756814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.756928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.757082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.757515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.757695 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.759467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.759621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.872602 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1327/2687] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.873426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.883723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f63d-850f-4f21-a777-e79178a82d43 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.888673 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.892484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.892484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.892484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] PATH_INFO: `/v3/projects/6c83eed698e34e048a77bfbe26b1b645/users/39ba8b8bd0e64ebb850f3cda9eea78c5/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.899963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1361/2688] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:43:59.899963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.907945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c83eed698e34e048a77bfbe26b1b645, user_id=39ba8b8bd0e64ebb850f3cda9eea78c5, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.910929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.961061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d3110-55d5-45e3-ae05-6caea7430954 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:43:59.966430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:43:59.967421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:43:59.967740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:43:59.968019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:43:59.968669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:43:59.970512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:43:59.974928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:43:59.982729 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1362/2689] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:43:59.984431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:43:59.997928 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f015-dc38-4aad-b716-752db23aa6da admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.002620 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.003211 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.003510 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.003809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.005188 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.007237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738d6f6-8e1f-402a-b013-f75def7d93f5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.017759 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1328/2690] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:43:59 2022] PUT /identity/v3/projects/6c83eed698e34e048a77bfbe26b1b645/users/39ba8b8bd0e64ebb850f3cda9eea78c5/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.033691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.033691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:00.095154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef10e8-b1b7-4ed6-9af6-f4c4e9d38159 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.100303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.102510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.102510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.102510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] PATH_INFO: `/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf/users/99726639cc734ebfbce8d8cccb45c6bf/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.110873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1363/2691] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:43:59 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:00.110873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.110873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.110873 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.118490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9192e0d1f451c95741f6ad1b80eaf, user_id=99726639cc734ebfbce8d8cccb45c6bf, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.121186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.139712 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] MFA Rules not processed for user `39ba8b8bd0e64ebb850f3cda9eea78c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:00.141055 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:00.204090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1329/2692] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:00 2022] PUT /identity/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf/users/99726639cc734ebfbce8d8cccb45c6bf/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.204860 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.213797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1364/2693] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:00.217386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.225580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847d10-cdfb-40f2-adbc-e2287a5debf4 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.272421 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6cff1-56d4-4b29-9a06-34cb070526ea admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.277441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.278049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.278336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.278619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.279271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.280920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.295703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1330/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:00.295703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.298036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.298658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.298933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.299260 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.299962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.302175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.303826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc57f42-bc03-4432-8e64-ff13ecbe4cac admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.308797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.309418 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.310425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.310425 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.310747 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.312628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.319246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1365/2695] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:00.324111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.330464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0fd0-e237-437d-812c-d147c6b36bd7 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.335822 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.336749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.337029 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.337429 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] PATH_INFO: `/v3/projects/ded1d91cdb33465b82986fbe6df090d8/users/3a4c8ee6547748dabf92286988bfe609/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.357687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded1d91cdb33465b82986fbe6df090d8, user_id=3a4c8ee6547748dabf92286988bfe609, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.360409 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.437393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1331/2696] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:00 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:00.437393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.469886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1366/2697] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:00 2022] PUT /identity/v3/projects/ded1d91cdb33465b82986fbe6df090d8/users/3a4c8ee6547748dabf92286988bfe609/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.470119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.502730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf3710-9ee9-4c7e-9423-fb38686f4fbf admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.504020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:00.516761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:00.559130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653824-60e3-40c7-b52c-2c232447722e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.564925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.565716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.566092 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.566464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.567364 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.570262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9668949-d0b1-44d8-a1d3-fd4c4b8ca1e6 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.580846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.581945 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.582568 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.583029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] PATH_INFO: `/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf/users/99726639cc734ebfbce8d8cccb45c6bf/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.585408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9192e0d1f451c95741f6ad1b80eaf, user_id=99726639cc734ebfbce8d8cccb45c6bf, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.588107 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.599550 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1332/2698] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:00 2022] PUT /identity/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf/users/99726639cc734ebfbce8d8cccb45c6bf/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.600385 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.658457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1367/2699] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:00 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:00.658457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95077c6-85a2-4076-ba5a-ce878cff7cd2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.658457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95077c6-85a2-4076-ba5a-ce878cff7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.658457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95077c6-85a2-4076-ba5a-ce878cff7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.671987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455847-8942-4022-9e86-9f5a4a4cff2d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.677622 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.678644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.679154 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.679445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.680306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.681921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.692061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-e95077c6-85a2-4076-ba5a-ce878cff7cd2 None None] MFA Rules not processed for user `99726639cc734ebfbce8d8cccb45c6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:00.695941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1333/2700] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:00.695941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.699521 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e95077c6-85a2-4076-ba5a-ce878cff7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:00.703648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6d30-674e-4f29-a2a4-137925670a51 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.709395 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.710023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.710306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.710598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.711229 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.712875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.737045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1334/2701] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:00.737045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.744333 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15dec9-34ce-4ca6-a210-afc8c55c3e03 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.750464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.751119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.751404 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.751710 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] PATH_INFO: `/v3/projects/ded1d91cdb33465b82986fbe6df090d8/users/3a4c8ee6547748dabf92286988bfe609/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.753642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded1d91cdb33465b82986fbe6df090d8, user_id=3a4c8ee6547748dabf92286988bfe609, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.756808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.767124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1335/2702] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:00 2022] PUT /identity/v3/projects/ded1d91cdb33465b82986fbe6df090d8/users/3a4c8ee6547748dabf92286988bfe609/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.767943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.774254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1368/2703] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:00.779735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.780116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.780463 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.809933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] MFA Rules not processed for user `3a4c8ee6547748dabf92286988bfe609`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:00.811146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:00.845547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e68ef-0b99-421c-98bd-39f3624092bc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.851072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.851712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.852016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.852322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.852966 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.854560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.864529 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1336/2704] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:00.865338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.866967 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:00.881468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1369/2705] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:00.885698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.888405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:00.897431 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eef82-cb8c-40b6-a12e-2198bd4cbacd None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.902058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.903061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.903061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.903287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] PATH_INFO: `/v3/projects/71d3f3edf0cb4bc9b6b76835a5eb8629/users/9df8b609faf44bc1ab15febe2ba9c30f/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.918701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d3f3edf0cb4bc9b6b76835a5eb8629, user_id=9df8b609faf44bc1ab15febe2ba9c30f, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.921487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:00.927346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5540-87e5-4d19-aef1-d602b1dff879 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:00.931749 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:00.932353 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:00.932632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:00.932903 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:00.986304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:00.992381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1370/2706] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:00 2022] PUT /identity/v3/projects/71d3f3edf0cb4bc9b6b76835a5eb8629/users/9df8b609faf44bc1ab15febe2ba9c30f/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:00.992914 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:00.993839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:00.994701 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:00.995569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779492b-cbe1-4137-84b3-1af4bb1ebe72 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.007099 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1337/2707] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:01.008515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.008943 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.009220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.039868 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] MFA Rules not processed for user `9df8b609faf44bc1ab15febe2ba9c30f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:01.041084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:01.062857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23894-aecb-4e38-8918-f53243e77079 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.067613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.068233 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.068546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.068935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.117012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1338/2708] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:01.118034 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.133255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.134773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.144420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1371/2709] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:01.187989 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=100 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.192534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f553b-6606-47cc-aeda-11522b544ed8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.197129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.202742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.202742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.202742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.202742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.202742 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.243400 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.252384 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a43dc-ae5d-4e90-bb96-6c849796cd92 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.256694 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.257306 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.257588 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.258105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.281155 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1339/2710] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:01 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:01.285104 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.330503 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.332596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.354105 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1372/2711] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:01.367112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fd88-4aa6-4c7b-afe5-575731c17455 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.373090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.373090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.373090 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.373411 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.374025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.375980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.444445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1340/2712] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:01 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:01.448817 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.461516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da22ea-bf6d-4b61-b3e8-b5b6e571f44b service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.466507 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.467228 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.467681 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.467966 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.468749 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.470606 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.486819 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1373/2713] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:01.487886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.499002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5bef-372b-409e-b753-4f9a5d08ec05 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.504208 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.505038 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.505461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.508128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] PATH_INFO: `/v3/projects/ba4b598940ef4649958a535beb647313/users/70ff8a92192543ad8a39fbec8c513219/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.524198 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4b598940ef4649958a535beb647313, user_id=70ff8a92192543ad8a39fbec8c513219, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.526953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.597512 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1341/2714] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:01 2022] PUT /identity/v3/projects/ba4b598940ef4649958a535beb647313/users/70ff8a92192543ad8a39fbec8c513219/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:01.602583 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.612656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dd651-decf-4008-b15a-07f3ad87f5d8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.651958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.670630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.671248 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.671560 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.671971 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.672630 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.674255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cb7fc-dd69-461e-b124-207d0a101a60 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.684295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1374/2715] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:01.688717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.699341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624af969-69e3-49ef-a74a-594b818c2462 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.704050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.704703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.704988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.705268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] PATH_INFO: `/v3/projects/ba4b598940ef4649958a535beb647313/users/70ff8a92192543ad8a39fbec8c513219/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.712108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4b598940ef4649958a535beb647313, user_id=70ff8a92192543ad8a39fbec8c513219, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.712108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.720902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1342/2716] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:01 2022] PUT /identity/v3/projects/ba4b598940ef4649958a535beb647313/users/70ff8a92192543ad8a39fbec8c513219/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:01.731710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.734134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.734134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.771901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] MFA Rules not processed for user `70ff8a92192543ad8a39fbec8c513219`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:01.771901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:01.839103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1375/2717] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:01.850244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:01.908832 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99c1b-4e5e-4c83-b14a-4fb6018a7c87 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:01.913087 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:01.913858 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:01.914271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:01.914558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:01.927063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:01.931699 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:01.938918 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1343/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:02.025744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:02.035818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe58590-b389-4418-9a06-a9fd40a3d9d5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:02.040399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:02.040979 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:02.045140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:02.045140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:02.100065 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:02.101500 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:02.110420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1376/2719] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:06.317445 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:06.339786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:06.350230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f808f01-4042-4f87-80b4-a083ac6c5d0d service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:06.354342 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:06.355175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:06.355457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:06.355774 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:06.363711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:06.386624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb635ad-dcce-47fb-982f-82da1e55943c service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:06.391477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:06.392129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:06.392412 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:06.392689 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] PATH_INFO: `/v3/users/39ba8b8bd0e64ebb850f3cda9eea78c5` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:06.393823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ba8b8bd0e64ebb850f3cda9eea78c5)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:06.395810 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:06.420134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:06.423466 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:06.424935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a96c7-7bae-4bef-9dd1-5d3f0cd13e20 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:06.434489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1377/2720] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:06.593607 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ba8b8bd0e64ebb850f3cda9eea78c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:06.594258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ba8b8bd0e64ebb850f3cda9eea78c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:06.601723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ba8b8bd0e64ebb850f3cda9eea78c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:06.613349 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ba8b8bd0e64ebb850f3cda9eea78c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:06.722906 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ba8b8bd0e64ebb850f3cda9eea78c5'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:06.729549 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1344/2721] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:06 2022] DELETE /identity/v3/users/39ba8b8bd0e64ebb850f3cda9eea78c5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:06.734300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:06.734590 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:06.734865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:06.755209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:06.757087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:06.817339 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1378/2722] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:06.828336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:06.829780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:06.887053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034208d-45a8-4edc-8987-97dae5371cbb admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:06.890632 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:06.891258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:06.891569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:06.891850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:06.901354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:06.902765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:06.912498 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1345/2723] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:07.425012 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:07.427643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:07.441692 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52b614-b2b3-4b8b-ac8b-e495945b87b6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:07.447302 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:07.448067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:07.449861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:07.449861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] PATH_INFO: `/v3/projects/6c83eed698e34e048a77bfbe26b1b645` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:07.450402 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c83eed698e34e048a77bfbe26b1b645)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:07.452323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:07.626517 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c83eed698e34e048a77bfbe26b1b645', 'request_id': 'req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:07.633062 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c83eed698e34e048a77bfbe26b1b645', 'request_id': 'req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:07.734566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c83eed698e34e048a77bfbe26b1b645', 'request_id': 'req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:07.747845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] The token cache is being invalidate because project 6c83eed698e34e048a77bfbe26b1b645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:07.748140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:07.748767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:07.750455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1379/2724] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:07 2022] DELETE /identity/v3/projects/6c83eed698e34e048a77bfbe26b1b645 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:07.754599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:07.764730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2360f5-4ae9-45ae-b9ec-08b4e2beab67 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:07.829672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:07.829672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:07.829672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:07.829672 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] PATH_INFO: `/v3/users/9df8b609faf44bc1ab15febe2ba9c30f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:07.830608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df8b609faf44bc1ab15febe2ba9c30f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:07.832601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:07.835211 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:08.012475 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df8b609faf44bc1ab15febe2ba9c30f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.013050 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df8b609faf44bc1ab15febe2ba9c30f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.021558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df8b609faf44bc1ab15febe2ba9c30f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.033807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df8b609faf44bc1ab15febe2ba9c30f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.088471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df8b609faf44bc1ab15febe2ba9c30f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.094623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1346/2725] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:07 2022] DELETE /identity/v3/users/9df8b609faf44bc1ab15febe2ba9c30f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:08.513035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:08.514785 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:08.530106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9162ae8-a6de-477e-8dd4-db1a4b48ad33 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:08.589617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:08.590250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:08.590530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:08.590803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] PATH_INFO: `/v3/projects/71d3f3edf0cb4bc9b6b76835a5eb8629` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:08.591965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d3f3edf0cb4bc9b6b76835a5eb8629)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:08.593867 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:08.617878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:08.732465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d3f3edf0cb4bc9b6b76835a5eb8629', 'request_id': 'req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.732465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d3f3edf0cb4bc9b6b76835a5eb8629', 'request_id': 'req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.848708 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d3f3edf0cb4bc9b6b76835a5eb8629', 'request_id': 'req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.860542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] The token cache is being invalidate because project 71d3f3edf0cb4bc9b6b76835a5eb8629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:08.860832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.861452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:08.862987 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1380/2726] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:08 2022] DELETE /identity/v3/projects/71d3f3edf0cb4bc9b6b76835a5eb8629 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:08.867733 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:08.869226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:08.883249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780ce2-89e1-4872-9042-385af3ccb852 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:08.947597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:08.948379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:08.948661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:08.948936 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] PATH_INFO: `/v3/users/70ff8a92192543ad8a39fbec8c513219` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:08.950056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ff8a92192543ad8a39fbec8c513219)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:08.951998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:09.176172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ff8a92192543ad8a39fbec8c513219'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.176756 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ff8a92192543ad8a39fbec8c513219'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.184049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ff8a92192543ad8a39fbec8c513219'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.196826 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ff8a92192543ad8a39fbec8c513219'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.316540 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-af3b0f9e-797e-49c7-abad-96ae92e9e9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ff8a92192543ad8a39fbec8c513219'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.318438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:09.326531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1347/2727] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:08 2022] DELETE /identity/v3/users/70ff8a92192543ad8a39fbec8c513219 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:09.725250 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:09.732453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:09.741470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6703bd4-1fcd-4787-b91d-ddd512b6ab81 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:09.805443 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:09.806103 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:09.806381 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:09.806657 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] PATH_INFO: `/v3/projects/ba4b598940ef4649958a535beb647313` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:09.807829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4b598940ef4649958a535beb647313)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:09.809735 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:09.934478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4b598940ef4649958a535beb647313', 'request_id': 'req-96e25816-64ae-48e8-a4d9-ded23887f1ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:09.939929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4b598940ef4649958a535beb647313', 'request_id': 'req-96e25816-64ae-48e8-a4d9-ded23887f1ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:10.031538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4b598940ef4649958a535beb647313', 'request_id': 'req-96e25816-64ae-48e8-a4d9-ded23887f1ba'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:10.046052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] The token cache is being invalidate because project ba4b598940ef4649958a535beb647313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:10.046389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:10.047155 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-96e25816-64ae-48e8-a4d9-ded23887f1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:10.048860 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1381/2728] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:09 2022] DELETE /identity/v3/projects/ba4b598940ef4649958a535beb647313 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:10.054921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.055391 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.055507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.076113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:10.077322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:10.140947 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1348/2729] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:10.150664 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.150953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.151231 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.170731 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:10.171974 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:10.180096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1382/2730] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:10.184517 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.194681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52af94-d255-4a61-924b-a51c214cbd07 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.199419 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.200043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.200322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.200594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.201232 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:10.201532 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.203308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.215396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1349/2731] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:10.219801 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.229289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6efb8-86e1-4d2f-b19f-dbf337dd5d7a None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.233991 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.234584 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.234865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.235141 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.235799 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.237683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.319457 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1383/2732] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:10 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:10.323738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.335009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f42dc-77f6-48fb-93a5-6fba54e1a6a6 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.394833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.395660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.395951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.397408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.397408 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.399152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.477597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1350/2733] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:10 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:10.482851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.494254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86be7-c943-4080-aa17-38b2a261d9e8 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.498868 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.504952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:10.513607 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1384/2734] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:10.517661 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.528986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa569a47-024c-431a-8d89-991d3ca0cc7a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.535697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.535697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.535697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.535697 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.536044 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.537586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.549257 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1351/2735] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:10.561796 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.575853 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8caca9-5b72-46a3-8a26-ca84af04c2be admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.578986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.579695 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.579980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.580262 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] PATH_INFO: `/v3/projects/4366dc78f3e442c59a3ea24a7b765511/users/845db6ec044a46edb977dcecfd312c12/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.597253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4366dc78f3e442c59a3ea24a7b765511, user_id=845db6ec044a46edb977dcecfd312c12, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.601315 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbc2d8-390e-42d1-a680-1667da0b3f21 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.686686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.688403 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:10.704287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d065f-d16a-404a-ba95-9b89313dfd2b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.707119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1385/2736] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:10 2022] PUT /identity/v3/projects/4366dc78f3e442c59a3ea24a7b765511/users/845db6ec044a46edb977dcecfd312c12/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:10.718965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.719253 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.719558 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.748816 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] MFA Rules not processed for user `845db6ec044a46edb977dcecfd312c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:10.750128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:10.764597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.765226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.765508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.765786 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] PATH_INFO: `/v3/users/8456918c4a9f4a1abd04b9342ef17ec1` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.767033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8456918c4a9f4a1abd04b9342ef17ec1)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.769305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.775342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:10.816219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1386/2737] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:10.827662 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.828935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:10.886474 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5220-73bf-4a26-a34e-cf0a906d3c9d None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.890164 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.890767 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.891050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.891325 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.900140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.901654 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:10.910552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1387/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:10.935566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:10.946660 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fc85a-480c-4f36-a33b-4123f78deab5 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:10.951197 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:10.951834 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:10.952117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:10.952389 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] PATH_INFO: `/v3/users/845db6ec044a46edb977dcecfd312c12` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:10.953502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] RBAC: Authorizing `identity:delete_user(user_id=845db6ec044a46edb977dcecfd312c12)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:10.955415 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:11.011042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8456918c4a9f4a1abd04b9342ef17ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.011723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8456918c4a9f4a1abd04b9342ef17ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.018572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8456918c4a9f4a1abd04b9342ef17ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.030991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8456918c4a9f4a1abd04b9342ef17ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.105787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c183b261-df15-4bc2-89ec-f3db083e9017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8456918c4a9f4a1abd04b9342ef17ec1'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.112306 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1352/2739] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:10 2022] DELETE /identity/v3/users/8456918c4a9f4a1abd04b9342ef17ec1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:11.117292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:11.117573 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:11.117843 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:11.137641 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:11.138861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:11.183956 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845db6ec044a46edb977dcecfd312c12'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.191423 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845db6ec044a46edb977dcecfd312c12'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.192119 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845db6ec044a46edb977dcecfd312c12'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.197307 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:11.201920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1353/2740] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:11.207218 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845db6ec044a46edb977dcecfd312c12'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.208019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-68d3f20a-81d7-43d0-997d-f5fed1a8308e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845db6ec044a46edb977dcecfd312c12'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.210717 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:11.212106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:11.269457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b929b8-bb5b-46b8-b16d-cc240e3a3665 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:11.273597 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:11.274205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:11.274485 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:11.274761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:11.278129 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1388/2741] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:10 2022] DELETE /identity/v3/users/845db6ec044a46edb977dcecfd312c12 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:11.282516 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:11.282809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:11.283089 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:11.285964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:11.287598 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:11.297451 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1354/2742] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:11.301940 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:11.304327 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:11.376897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1389/2743] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:11.393993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:11.407244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78beace-ba57-4bfc-bbda-2ebc1e6e5f74 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:11.432664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:11.459814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:11.460441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:11.473703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:11.473703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:11.473703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:11.473703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:11.482638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1355/2744] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:11.750261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:11.752506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:11.768019 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91267ae-7253-43b0-bdf8-0f40a753c32f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:11.773977 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:11.774621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:11.774899 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:11.775175 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] PATH_INFO: `/v3/projects/c76f151620d143cba5fb27bf6b919769` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:11.776506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76f151620d143cba5fb27bf6b919769)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:11.779237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:11.907697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76f151620d143cba5fb27bf6b919769', 'request_id': 'req-03dfac7e-eeae-4af5-84da-583fbe72e91b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.913983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76f151620d143cba5fb27bf6b919769', 'request_id': 'req-03dfac7e-eeae-4af5-84da-583fbe72e91b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:11.964423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:11.965846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:11.979230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686685-f4f2-41f1-8da0-388eb888d6d3 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.008885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76f151620d143cba5fb27bf6b919769', 'request_id': 'req-03dfac7e-eeae-4af5-84da-583fbe72e91b'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.020757 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] The token cache is being invalidate because project c76f151620d143cba5fb27bf6b919769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:12.021397 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.022051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.023596 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1390/2745] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:11 2022] DELETE /identity/v3/projects/c76f151620d143cba5fb27bf6b919769 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:12.027428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.028758 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.039214 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.039886 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.040166 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.040881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] PATH_INFO: `/v3/projects/4366dc78f3e442c59a3ea24a7b765511` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.041715 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4366dc78f3e442c59a3ea24a7b765511)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.043642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.095614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfac7e-eeae-4af5-84da-583fbe72e91b admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.100396 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.101022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.101304 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.101586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] PATH_INFO: `/v3/users/99726639cc734ebfbce8d8cccb45c6bf` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.102781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99726639cc734ebfbce8d8cccb45c6bf)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.104804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.107112 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:12.129664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4366dc78f3e442c59a3ea24a7b765511', 'request_id': 'req-ba21c0ac-d834-475e-aa61-cd31249e7293'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.135875 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4366dc78f3e442c59a3ea24a7b765511', 'request_id': 'req-ba21c0ac-d834-475e-aa61-cd31249e7293'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.213890 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4366dc78f3e442c59a3ea24a7b765511', 'request_id': 'req-ba21c0ac-d834-475e-aa61-cd31249e7293'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.225787 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] The token cache is being invalidate because project 4366dc78f3e442c59a3ea24a7b765511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:12.226075 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.226694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ba21c0ac-d834-475e-aa61-cd31249e7293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.228224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1356/2746] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:11 2022] DELETE /identity/v3/projects/4366dc78f3e442c59a3ea24a7b765511 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:12.232807 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3a6b-69ec-4022-9a1a-cec6d2789fb3 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.233091 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3a6b-69ec-4022-9a1a-cec6d2789fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.233366 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3a6b-69ec-4022-9a1a-cec6d2789fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.252640 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-cdaa3a6b-69ec-4022-9a1a-cec6d2789fb3 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:12.253831 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cdaa3a6b-69ec-4022-9a1a-cec6d2789fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.303283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:12.314081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1357/2747] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:12.320426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99726639cc734ebfbce8d8cccb45c6bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.321705 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.321987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.322258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.327121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99726639cc734ebfbce8d8cccb45c6bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.327807 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99726639cc734ebfbce8d8cccb45c6bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.339856 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99726639cc734ebfbce8d8cccb45c6bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.340567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99726639cc734ebfbce8d8cccb45c6bf'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.342290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:12.343655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.352964 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1358/2748] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:12.357098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.367685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c39def-7e32-42a6-ad5d-26f1061cd7ec None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.372515 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.373110 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.373388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.373660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.374302 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:12.374613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.376251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.387833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1359/2749] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:44:12.393752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.403380 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf4f-abd9-4a23-909f-df9ae9c7b1e8 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.407959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.408527 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.408805 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.409081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.409690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.412238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.425720 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1391/2750] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:12 2022] DELETE /identity/v3/users/99726639cc734ebfbce8d8cccb45c6bf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:12.439848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.442499 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.506171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4264-3672-498a-9e46-e0d73398e42f admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.510811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.511440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.511748 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.512020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] PATH_INFO: `/v3/users/db51127b9f944ca781872a01794eda67` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.513159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db51127b9f944ca781872a01794eda67)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.515158 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.547535 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1360/2751] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:12.551457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.611205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca54b-c1cf-4441-8ba8-1de9d9a7fccd admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.615907 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.616504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.616785 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.617058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.617670 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.619726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.723305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1361/2752] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:12.727830 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.737664 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9a3e-c3ff-4222-a5b9-740cab1904a9 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.743946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.744974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.745471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.750685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.750685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.750685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.757118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db51127b9f944ca781872a01794eda67'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.762816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1362/2753] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:44:12.764144 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.765219 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db51127b9f944ca781872a01794eda67'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.766050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db51127b9f944ca781872a01794eda67'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.776593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913a7a-3b8d-4beb-a8e4-99cc50e492b7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.779759 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db51127b9f944ca781872a01794eda67'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.780458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-a58fb3fe-c3ac-4ffa-9932-6ada725c837f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db51127b9f944ca781872a01794eda67'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:12.782441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.783567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.783941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.784621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.785289 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.787889 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.799778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1363/2754] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:44:12.804145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.805824 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.818416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc7363-51c7-480a-80b0-e6b8de2b4e1d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.823032 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.823719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.824033 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.824309 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] PATH_INFO: `/v3/projects/0f8b0471b8be40339ab718e1e153274e/users/c24d3893b0ea41528ac40df80e377b98/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.839024 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8b0471b8be40339ab718e1e153274e, user_id=c24d3893b0ea41528ac40df80e377b98, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.841702 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:12.862009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:12.866487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1392/2755] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:12 2022] DELETE /identity/v3/users/db51127b9f944ca781872a01794eda67 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:12.870852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a31435-3171-4604-a575-1ccc596df0de None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.871134 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a31435-3171-4604-a575-1ccc596df0de None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.871408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a31435-3171-4604-a575-1ccc596df0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.890937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-50a31435-3171-4604-a575-1ccc596df0de None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:12.892269 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-50a31435-3171-4604-a575-1ccc596df0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.895814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1364/2756] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:12 2022] PUT /identity/v3/projects/0f8b0471b8be40339ab718e1e153274e/users/c24d3893b0ea41528ac40df80e377b98/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:12.897628 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:12.899314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:12.966017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1393/2757] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:12.969337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.969337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.969337 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.981941 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0afdc5-e3ec-4a58-bce7-82a7d972c656 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:12.990372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:12.990974 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:12.991262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:12.991629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] PATH_INFO: `/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:12.992795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e9192e0d1f451c95741f6ad1b80eaf)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:12.994795 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.000408 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] MFA Rules not processed for user `c24d3893b0ea41528ac40df80e377b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:13.001852 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.002965 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:13.069687 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1394/2758] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:13.070543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.071849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.089513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e9192e0d1f451c95741f6ad1b80eaf', 'request_id': 'req-8c2a901d-edd4-49c6-8f01-f7c94b734d67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.095045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e9192e0d1f451c95741f6ad1b80eaf', 'request_id': 'req-8c2a901d-edd4-49c6-8f01-f7c94b734d67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.129108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f65e-da2b-4a85-b701-15a741d1bae5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.168478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e9192e0d1f451c95741f6ad1b80eaf', 'request_id': 'req-8c2a901d-edd4-49c6-8f01-f7c94b734d67'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.177132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.177889 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.178222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.178502 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.180281 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] The token cache is being invalidate because project 15e9192e0d1f451c95741f6ad1b80eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:13.180956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.182172 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.184094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1365/2759] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:12 2022] DELETE /identity/v3/projects/15e9192e0d1f451c95741f6ad1b80eaf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:13.184604 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.185951 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.244767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a901d-edd4-49c6-8f01-f7c94b734d67 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.244985 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.246380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0838a-3ee5-460e-8a1b-e1265422f679 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.248572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.249201 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.249465 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.249738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.251537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.258017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1395/2760] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:13.260903 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c927-ff50-4bfb-a928-73a50c195675 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.261458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c927-ff50-4bfb-a928-73a50c195675 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.261836 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c927-ff50-4bfb-a928-73a50c195675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.287605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-29e8c927-ff50-4bfb-a928-73a50c195675 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:13.289035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-29e8c927-ff50-4bfb-a928-73a50c195675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.303983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1396/2761] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:13.306077 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.307113 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.307237 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.323561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.325004 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.332079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:13.333554 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.335210 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1366/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:13.342930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1397/2763] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:13.347217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:13.347386 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.359230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5840343-fa2a-4504-aa91-0426bbfc667f service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.364016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.364635 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.365490 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.365780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.366503 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:13.366816 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.368470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.381331 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1367/2764] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:13.386808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.397270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12f3b6-aba4-4638-8d37-6f11afd9e193 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.402132 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.402740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.403024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.403299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.404968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.406018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.514075 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1398/2765] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:13.517789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.528935 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bb45-3304-44f8-8a99-d5312a25a3ab admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.560362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:13.589388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.589994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.590275 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.590547 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.591176 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.593119 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.656004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.657847 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.672933 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b07a7-4349-4902-a3e6-ccc2388103af admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.673088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1368/2766] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:13.677734 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.680006 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.681037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.681556 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.682095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] PATH_INFO: `/v3/projects/635319d08650407c8e8ee28c8daab6c6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.683714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635319d08650407c8e8ee28c8daab6c6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.686244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.688888 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ea4f-3c00-4f37-81f4-23adaa057d1c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.695642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.696472 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.696833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.697114 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.697797 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.699621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.711046 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1369/2767] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:13.715225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.725319 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b12df-2821-4b21-88dc-592f866e9dd5 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.730467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.731521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.731521 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.731744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.732236 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.733854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.745894 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1370/2768] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:44:13.750338 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.760290 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4082d-5260-442c-a727-3b4459470b73 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.767352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:13.767352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.767352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.767352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] PATH_INFO: `/v3/projects/1c5a47f7d4e04d418ce3fe7b40cb0fee/users/be9b4fb905214e36bbd797a20913f59d/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.781412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635319d08650407c8e8ee28c8daab6c6', 'request_id': 'req-067f6514-2d8c-4c8f-8089-2adfd41640c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.781919 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5a47f7d4e04d418ce3fe7b40cb0fee, user_id=be9b4fb905214e36bbd797a20913f59d, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:13.784253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a8fc-26e4-41cd-ab3a-954e3e633cf3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:13.790268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635319d08650407c8e8ee28c8daab6c6', 'request_id': 'req-067f6514-2d8c-4c8f-8089-2adfd41640c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.848649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635319d08650407c8e8ee28c8daab6c6', 'request_id': 'req-067f6514-2d8c-4c8f-8089-2adfd41640c5'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.855649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1371/2769] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:13 2022] PUT /identity/v3/projects/1c5a47f7d4e04d418ce3fe7b40cb0fee/users/be9b4fb905214e36bbd797a20913f59d/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:13.861046 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] The token cache is being invalidate because project 635319d08650407c8e8ee28c8daab6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:13.861370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.862035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:13.863570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1399/2770] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:13 2022] DELETE /identity/v3/projects/635319d08650407c8e8ee28c8daab6c6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:13.867958 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.868560 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:13.868845 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:13.869121 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:13.869277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.898768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] MFA Rules not processed for user `be9b4fb905214e36bbd797a20913f59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:13.900083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:13.918742 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:13.943864 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6514-2d8c-4c8f-8089-2adfd41640c5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:13.978986 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1372/2771] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:13.983963 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:13.986688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:14.019323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.019919 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.020204 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.020478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] PATH_INFO: `/v3/users/3a4c8ee6547748dabf92286988bfe609` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.022049 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4c8ee6547748dabf92286988bfe609)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.024028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.070161 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f947c-71e6-4a85-a147-32148ae22ed1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.075854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.075854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.075854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.076162 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.076585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.078536 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.090712 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:14.227045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1373/2772] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:13 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:14.231059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.257298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4c8ee6547748dabf92286988bfe609'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:14.264287 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4c8ee6547748dabf92286988bfe609'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:14.264970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4c8ee6547748dabf92286988bfe609'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:14.277741 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4c8ee6547748dabf92286988bfe609'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:14.278525 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4c8ee6547748dabf92286988bfe609'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:14.292488 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bf44-c1ad-470c-908e-00d8435b43c7 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.297209 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.297814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.298097 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.298416 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.299068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.301019 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.374869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1400/2773] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:13 2022] DELETE /identity/v3/users/3a4c8ee6547748dabf92286988bfe609 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:14.415054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1374/2774] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:14 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:14.419024 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.420489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:14.488733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4dd3-3605-4042-816b-3b0c08c0ff50 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.494117 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.494793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.495078 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.495355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.496072 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.497714 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.507949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1401/2775] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:44:14.512215 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.522730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be7b2-2d8b-4cf7-acee-02d9f882ea9d admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.527650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.528373 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.528606 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.528881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] PATH_INFO: `/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6/users/0cf9bbd66f674e08a0bbfa239197a09c/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.544456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f265bdc7fb439ca5c33d9b2ee3c4e6, user_id=0cf9bbd66f674e08a0bbfa239197a09c, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.547106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.626736 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1375/2776] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:14 2022] PUT /identity/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6/users/0cf9bbd66f674e08a0bbfa239197a09c/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:14.630647 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.640937 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14131-073c-4f48-b866-dd4043ed0031 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.644929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:14.699580 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.700195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.700486 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.700753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.701399 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.703047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4f99-3858-4e9b-b64a-2eee2b92c6cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.714170 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1402/2777] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:14.718504 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.729583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45f22-2e4c-4083-ac70-b449b40fafdc admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.734543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.735239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.735567 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.735846 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] PATH_INFO: `/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6/users/0cf9bbd66f674e08a0bbfa239197a09c/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.737990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f265bdc7fb439ca5c33d9b2ee3c4e6, user_id=0cf9bbd66f674e08a0bbfa239197a09c, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.741480 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.751981 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1376/2778] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:14 2022] PUT /identity/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6/users/0cf9bbd66f674e08a0bbfa239197a09c/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:14.768604 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.768893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.769171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.788863 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.790766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:14.801951 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] MFA Rules not processed for user `0cf9bbd66f674e08a0bbfa239197a09c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:14.803353 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:14.860703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261dcd-8414-4b2e-8c26-79644454262b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.865430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.866059 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.866337 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.866612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] PATH_INFO: `/v3/projects/ded1d91cdb33465b82986fbe6df090d8` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.867762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded1d91cdb33465b82986fbe6df090d8)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.869676 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.881642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1403/2779] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:14.893020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:14.895278 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:14.955331 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a7a9-2375-4805-bce2-6d999cf0532f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:14.959658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:14.960263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:14.960546 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:14.960823 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:14.969690 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:14.971108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57da092-270d-40e3-8ffc-b4d8948da224 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:14.982509 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1404/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:14.997561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:15.000253 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded1d91cdb33465b82986fbe6df090d8', 'request_id': 'req-304161df-8c6c-4d68-86ed-b90d7b39719d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:15.005647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded1d91cdb33465b82986fbe6df090d8', 'request_id': 'req-304161df-8c6c-4d68-86ed-b90d7b39719d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:15.077484 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded1d91cdb33465b82986fbe6df090d8', 'request_id': 'req-304161df-8c6c-4d68-86ed-b90d7b39719d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:15.092985 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] The token cache is being invalidate because project ded1d91cdb33465b82986fbe6df090d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:15.093376 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:15.094047 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-304161df-8c6c-4d68-86ed-b90d7b39719d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:15.095912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1377/2781] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:14 2022] DELETE /identity/v3/projects/ded1d91cdb33465b82986fbe6df090d8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:15.102670 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.102900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.103116 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.124845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:15.126094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:15.154446 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=100 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:15.196334 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1405/2782] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:15.198413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.198762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.199041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.221173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:15.222389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:15.231405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1378/2783] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:15.236292 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.248764 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0506eb-8a3c-4340-9ad9-0c558af16901 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.253781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.254420 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.254704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.254980 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.255925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:15.256261 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.257942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.271528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1406/2784] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:15.275406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.285096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a7bc-690e-41a6-96ea-0290e65ab465 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.290381 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.290988 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.291271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.291586 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.292233 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.294135 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.409594 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1379/2785] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:15 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:15.415045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.425826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72e7b4-b759-43e1-8e60-1b4721d7da16 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.494064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.494683 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.495087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.495371 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.496048 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.498126 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.592083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1407/2786] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:15 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:15.593314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.604700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530745-978d-494b-badc-0296c969ee96 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.609297 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.609915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.610193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.610464 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.611133 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.612802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.622639 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1380/2787] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:15.626771 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.637100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823877f-70f3-4937-b0ab-67aff6fcbb55 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.641935 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.642567 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.642932 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.643215 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.643893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.645489 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d4082-c86b-4caa-bf65-5fe3030b3648 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.656106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1408/2788] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:15.660426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.671616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43de0-6741-4e71-a43d-c21690858d1a admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:15.676358 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:15.677009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.677304 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.677572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] PATH_INFO: `/v3/projects/1c81f1a693bc4943bd629932e71eb669/users/ca3bd55f87e24b9488dddddccb35118c/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.692909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c81f1a693bc4943bd629932e71eb669, user_id=ca3bd55f87e24b9488dddddccb35118c, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:15.695570 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:15.763112 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1381/2789] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:15 2022] PUT /identity/v3/projects/1c81f1a693bc4943bd629932e71eb669/users/ca3bd55f87e24b9488dddddccb35118c/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:15.776324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:15.776612 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:15.776887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:15.805821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] MFA Rules not processed for user `ca3bd55f87e24b9488dddddccb35118c`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:15.807052 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:15.875552 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1409/2790] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:15.972789 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:15.975323 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:16.046489 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b4289-9775-4e46-8488-bf3c7c0a76ed admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:16.050436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:16.051042 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:16.051320 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:16.051623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:16.061765 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:16.063396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785e7d2-81c0-4de6-8b85-f9229f832c57 service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:16.076213 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1382/2791] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:16.096376 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:16.127938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:16.161848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fad90-6dde-4f46-9d9a-838a97c05102 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:16.166569 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:16.167314 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:16.167726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:16.167957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] PATH_INFO: `/v3/users/ca3bd55f87e24b9488dddddccb35118c` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:16.169086 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3bd55f87e24b9488dddddccb35118c)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:16.171004 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:16.371432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3bd55f87e24b9488dddddccb35118c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:16.378464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3bd55f87e24b9488dddddccb35118c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:16.379130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3bd55f87e24b9488dddddccb35118c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:16.392392 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3bd55f87e24b9488dddddccb35118c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:16.393074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3bd55f87e24b9488dddddccb35118c'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:16.523050 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1410/2792] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:16 2022] DELETE /identity/v3/users/ca3bd55f87e24b9488dddddccb35118c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:16.527601 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:16.528082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:16.528203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:16.547400 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:16.548770 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:16.608878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1383/2793] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:16.619200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:16.623631 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:16.690648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717691a-aad0-434d-95cf-b970b5df3729 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:16.695336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:16.695983 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:16.696293 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:16.696571 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:16.705561 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:16.706986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddd08c-b98d-45f1-b528-5a221bfd10c9 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:16.717222 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1411/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:17.284466 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:17.285885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:17.297821 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88460a-5cd6-40c3-a91d-43a57fcfc528 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:17.303105 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:17.303744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.304043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.304522 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] PATH_INFO: `/v3/projects/1c81f1a693bc4943bd629932e71eb669` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.305675 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c81f1a693bc4943bd629932e71eb669)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:17.307659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:17.318842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:17.425997 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c81f1a693bc4943bd629932e71eb669', 'request_id': 'req-a989fa0c-abf0-4ac6-8428-c10770c5172a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:17.432043 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c81f1a693bc4943bd629932e71eb669', 'request_id': 'req-a989fa0c-abf0-4ac6-8428-c10770c5172a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:17.540282 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c81f1a693bc4943bd629932e71eb669', 'request_id': 'req-a989fa0c-abf0-4ac6-8428-c10770c5172a'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:17.553361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] The token cache is being invalidate because project 1c81f1a693bc4943bd629932e71eb669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:17.553833 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:17.554483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a989fa0c-abf0-4ac6-8428-c10770c5172a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:17.560865 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.561323 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.561433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.564074 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1384/2795] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:17 2022] DELETE /identity/v3/projects/1c81f1a693bc4943bd629932e71eb669 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:17.582426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:17.583884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:17.634656 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:17.649544 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1412/2796] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:17.657478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.657934 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.658274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.678856 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:17.680084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:17.687909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1385/2797] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:17.692038 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:17.701845 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd882a8c-6108-4872-8988-3dc4c293d01b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:17.706566 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:17.707166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.707451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.707755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] PATH_INFO: `/v3/domains` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.708482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81805) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:17.708786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:17.710582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:17.722277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1413/2798] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:17.727145 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:17.736341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db315-595a-459d-b07f-2e3939ec7395 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:17.745168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:17.748593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.748593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.748593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.748593 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:17.748952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:17.861600 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1386/2799] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:17 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:17.866150 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:17.876166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680198-057b-45d0-ab05-1e2845d1acca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:17.938491 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:17.939042 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:17.939379 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:17.939684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:17.940312 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:17.942230 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.077666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1414/2800] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:17 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:18.081882 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.093118 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38420-c0ff-43ee-bf9f-d571b4140f91 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.098575 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.099850 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.100125 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.100394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.101045 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.102647 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.112960 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1387/2801] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:18.117385 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.127952 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76847d-b373-4c2a-9bce-29857cfd10a4 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.133549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.134151 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.134433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.134710 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.135349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.137031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.148482 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1415/2802] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:18.152738 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.163667 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ab48-6555-4109-9724-ecb84709be38 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.168322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.168973 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.169252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.172406 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] PATH_INFO: `/v3/projects/1043678d40a14b93bfe03de5e9f9a411/users/5e08d01e55b5475399e1b0203f47f1a0/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.184768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1043678d40a14b93bfe03de5e9f9a411, user_id=5e08d01e55b5475399e1b0203f47f1a0, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.187399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41cb7-c6bd-42f6-9707-f6ed2c38e709 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.219805 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.221540 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.234902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb4c0-5aba-4832-a978-4cab8ad42dd5 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.239760 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.246881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.246881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.246881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] PATH_INFO: `/v3/users/be9b4fb905214e36bbd797a20913f59d` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.246881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9b4fb905214e36bbd797a20913f59d)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.246881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.345782 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1388/2803] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:18 2022] PUT /identity/v3/projects/1043678d40a14b93bfe03de5e9f9a411/users/5e08d01e55b5475399e1b0203f47f1a0/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:18.356691 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.356982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.357260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.386436 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] MFA Rules not processed for user `5e08d01e55b5475399e1b0203f47f1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:18.387679 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.445542 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9b4fb905214e36bbd797a20913f59d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:18.452906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9b4fb905214e36bbd797a20913f59d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:18.456921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1389/2804] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:18.457328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9b4fb905214e36bbd797a20913f59d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:18.465207 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.466557 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.470804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9b4fb905214e36bbd797a20913f59d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:18.471505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-548911bb-36b2-4b65-9b13-f94f83f0067d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9b4fb905214e36bbd797a20913f59d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:18.493031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:18.524572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff4d8d-470d-4766-9362-d37b8377164e None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.528334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.528952 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.529234 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.529510 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.531330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.540753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1416/2805] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:18 2022] DELETE /identity/v3/users/be9b4fb905214e36bbd797a20913f59d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:18.548450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.548450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.551957 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.552283 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.552775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.556109 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1390/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:18.574524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:18.575841 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.600246 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:18.638821 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1417/2807] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:18.649397 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:18.650823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:18.712707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eb976-f7d1-4eb3-8cd2-816e89df09ed service cinder] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:18.760342 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:18.760954 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:18.761240 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:18.761519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:18.770435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:18.772252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:18.781852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1391/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:19.227744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:19.229221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:19.243324 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89b40-338f-4a82-9041-71e36d7d5460 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:19.247965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:19.248601 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:19.248887 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:19.249146 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] PATH_INFO: `/v3/projects/1c5a47f7d4e04d418ce3fe7b40cb0fee` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:19.250412 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5a47f7d4e04d418ce3fe7b40cb0fee)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:19.252442 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:19.383422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5a47f7d4e04d418ce3fe7b40cb0fee', 'request_id': 'req-1e299bcf-aede-4746-b08f-c5da42b21f2d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.392354 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5a47f7d4e04d418ce3fe7b40cb0fee', 'request_id': 'req-1e299bcf-aede-4746-b08f-c5da42b21f2d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.454328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5a47f7d4e04d418ce3fe7b40cb0fee', 'request_id': 'req-1e299bcf-aede-4746-b08f-c5da42b21f2d'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.466227 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] The token cache is being invalidate because project 1c5a47f7d4e04d418ce3fe7b40cb0fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:19.466513 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.467140 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.468634 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1418/2809] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:19 2022] DELETE /identity/v3/projects/1c5a47f7d4e04d418ce3fe7b40cb0fee => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:19.472663 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:19.483377 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be9da-8ee8-4442-9f41-75a20497f757 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:19.541898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:19.542528 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:19.542808 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:19.543079 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] PATH_INFO: `/v3/users/0cf9bbd66f674e08a0bbfa239197a09c` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:19.544268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf9bbd66f674e08a0bbfa239197a09c)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:19.546180 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:19.660942 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:19.765531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf9bbd66f674e08a0bbfa239197a09c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.766203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf9bbd66f674e08a0bbfa239197a09c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.774865 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf9bbd66f674e08a0bbfa239197a09c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.787023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf9bbd66f674e08a0bbfa239197a09c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.905274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-076bb812-fcf5-47ac-b3d8-8d97eb886e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf9bbd66f674e08a0bbfa239197a09c'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:19.912053 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1392/2810] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:19 2022] DELETE /identity/v3/users/0cf9bbd66f674e08a0bbfa239197a09c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:20.295593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:20.297638 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:20.313421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e299bcf-aede-4746-b08f-c5da42b21f2d admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:20.379316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:20.380289 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:20.380901 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:20.381487 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] PATH_INFO: `/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:20.383740 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f265bdc7fb439ca5c33d9b2ee3c4e6)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:20.385027 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:20.530070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f265bdc7fb439ca5c33d9b2ee3c4e6', 'request_id': 'req-0f319e17-d41a-4039-9911-7e668e3d921f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:20.532328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:20.537761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f265bdc7fb439ca5c33d9b2ee3c4e6', 'request_id': 'req-0f319e17-d41a-4039-9911-7e668e3d921f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:20.648481 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f265bdc7fb439ca5c33d9b2ee3c4e6', 'request_id': 'req-0f319e17-d41a-4039-9911-7e668e3d921f'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:20.659732 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] The token cache is being invalidate because project 37f265bdc7fb439ca5c33d9b2ee3c4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:20.660017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:20.660629 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-0f319e17-d41a-4039-9911-7e668e3d921f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:20.662755 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1419/2811] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:20 2022] DELETE /identity/v3/projects/37f265bdc7fb439ca5c33d9b2ee3c4e6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:20.667686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:20.668136 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:20.668266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:20.688242 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:20.689438 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:20.749347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1393/2812] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:20.757452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:20.757738 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:20.758010 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:20.777455 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:20.778898 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:20.787276 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1420/2813] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:20.798648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:20.801294 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974eec5-03ad-4f58-ad4e-0dce23e26a69 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:20.806508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:20.807102 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:20.807384 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:20.807688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:20.808336 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:20.808642 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:20.810268 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:20.821582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1394/2814] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:20.826217 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:20.836139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f167-f449-447b-9d96-43e017eb5c4b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:20.840895 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:20.841505 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:20.841793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:20.842071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:20.842704 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:20.844685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.025458 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1421/2815] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:20 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:21.026571 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:21.040322 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1cf4-c45c-49c3-99ca-ae36d24884e3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:21.096081 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:21.096688 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.097077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.097278 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.097895 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:21.100608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.208435 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1395/2816] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:21 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:21.213605 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:21.224001 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae91e-4fbd-4d47-ab53-f427ae7e1238 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:21.228611 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:21.229210 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.229495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.229772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.230417 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:21.232061 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.241907 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1422/2817] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:21.245884 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:21.255920 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb445-cbab-4320-b8fc-87eb0afac183 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:21.261078 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:21.261616 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.261898 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.262173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.262812 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:21.264483 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb45e-3bf1-4cc1-8d33-fea18e460a92 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.276239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1396/2818] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:21.280290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:21.290537 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621b65-0856-4499-ac5a-324c049d290e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:21.295202 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:21.295884 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.296453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.296453 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] PATH_INFO: `/v3/projects/fd111633feef441580a5c59dd87c628b/users/22eae9b51740427899d2303b24c70459/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.312070 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd111633feef441580a5c59dd87c628b, user_id=22eae9b51740427899d2303b24c70459, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:21.315969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.404245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1423/2819] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:21 2022] PUT /identity/v3/projects/fd111633feef441580a5c59dd87c628b/users/22eae9b51740427899d2303b24c70459/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:21.415084 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.415378 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.415746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.435698 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:21.444980 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] MFA Rules not processed for user `22eae9b51740427899d2303b24c70459`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:21.446246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:21.512262 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1397/2820] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:21.524005 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:21.525744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:21.586047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f311-7609-48c4-bb79-e420e2af06eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:21.589815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:21.590478 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:21.590752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:21.591031 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:21.600236 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:21.601806 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555d58e-0498-4788-9dc0-e246e39b9d1a service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:21.612074 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1424/2821] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:29.074778 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:29.139681 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7a0e-b8a1-4e31-a981-97a7ee252104 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:29.144283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:29.144911 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:29.145196 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:29.145471 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] PATH_INFO: `/v3/users/22eae9b51740427899d2303b24c70459` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:29.146862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] RBAC: Authorizing `identity:delete_user(user_id=22eae9b51740427899d2303b24c70459)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:29.148861 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:29.330128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22eae9b51740427899d2303b24c70459'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:29.330811 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22eae9b51740427899d2303b24c70459'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:29.339224 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22eae9b51740427899d2303b24c70459'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:29.351271 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22eae9b51740427899d2303b24c70459'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:29.407905 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22eae9b51740427899d2303b24c70459'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:29.415153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1398/2822] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:29 2022] DELETE /identity/v3/users/22eae9b51740427899d2303b24c70459 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:29.419777 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:29.420264 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:29.420368 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:29.440020 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:29.448699 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:29.500778 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1425/2823] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:29.511168 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:29.512862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:29.536752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:29.579063 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3baa-6297-45c4-beb4-4ed8345479db admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:29.582743 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:29.583362 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:29.583707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:29.583987 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:29.594169 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:29.595644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffffb6e-1958-4a81-8b25-fed35d6b6fbb service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:29.606491 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1399/2824] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:30.034515 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.035018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:30.049290 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb96213-3198-4d28-886e-6961b28139b0 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.055100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.056083 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.056365 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.056642 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] PATH_INFO: `/v3/projects/fd111633feef441580a5c59dd87c628b` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.057813 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd111633feef441580a5c59dd87c628b)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.059779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.077333 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:30.175245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd111633feef441580a5c59dd87c628b', 'request_id': 'req-8afbc10a-a489-4ee0-969a-b536f1e62765'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:30.180745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd111633feef441580a5c59dd87c628b', 'request_id': 'req-8afbc10a-a489-4ee0-969a-b536f1e62765'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:30.305136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd111633feef441580a5c59dd87c628b', 'request_id': 'req-8afbc10a-a489-4ee0-969a-b536f1e62765'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:30.316950 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] The token cache is being invalidate because project fd111633feef441580a5c59dd87c628b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:30.317240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:30.317965 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-8afbc10a-a489-4ee0-969a-b536f1e62765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:30.320448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1426/2825] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:30 2022] DELETE /identity/v3/projects/fd111633feef441580a5c59dd87c628b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:30.325374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.326723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.326723 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.347508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:30.348780 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:30.412572 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1400/2826] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:30.420413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.422015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.422015 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.441125 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:30.445570 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:30.450779 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1427/2827] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:30.455308 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.467005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d41d5-10c7-4c42-8170-c803e0874004 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.471862 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.472470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.472752 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.473025 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.473703 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:30.474007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.475656 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.487261 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1401/2828] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:30.491716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.501106 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188539ea-fedb-4e64-87c4-dd4527670e0f None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.506916 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.508243 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.508682 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.508969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.509645 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.511644 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.604142 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1428/2829] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:30 2022] POST /identity/v3/projects => generated 359 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:30.608356 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.619241 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c37074-c5e0-49e3-b2a4-95a6d40cac04 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.677996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.678629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.678915 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.679706 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.680357 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.682274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.775205 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1402/2830] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:30 2022] POST /identity/v3/users => generated 280 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:30.779467 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.791522 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1fbfa-f964-4bbf-a74e-b62c36ddae18 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.796452 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.798506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.798506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.798506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.798506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.799997 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.812514 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1429/2831] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:30.816730 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.827520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3da60-becf-422b-bf77-815b96acb64b admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.832007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.839056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.839056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.839056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.839056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.839056 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f3b88-1753-4fdf-90e6-66a6b905a23c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.846893 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1403/2832] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:30.851284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:30.861586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0d59-6d4e-4540-bac2-2f18ce9ee5cc admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:30.866080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:30.867263 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.867828 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.868178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] PATH_INFO: `/v3/projects/be6b2e8815d64629b6b6b77f6aea817a/users/ab6eef0c244147d39345198595406b00/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.882468 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6b2e8815d64629b6b6b77f6aea817a, user_id=ab6eef0c244147d39345198595406b00, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:30.885679 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:30.942639 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1430/2833] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:30 2022] PUT /identity/v3/projects/be6b2e8815d64629b6b6b77f6aea817a/users/ab6eef0c244147d39345198595406b00/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:30.953460 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:30.953766 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:30.954049 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:30.983100 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] MFA Rules not processed for user `ab6eef0c244147d39345198595406b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:30.984388 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:30.999153 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:31.053719 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1404/2834] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:31.090949 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:31.092855 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:31.154462 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b3aa3-13cc-4440-a687-731916ea1a12 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:31.158111 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:31.158726 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.159009 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.159285 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.168754 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:31.170195 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:31.181355 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1431/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:31.182912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:31.184497 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:31.196669 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:31.248060 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:31.254478 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309bab-c4ba-4d9b-9e4f-55b19d9140d4 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:31.259343 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:31.260009 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.260291 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.260562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] PATH_INFO: `/v3/users/5e08d01e55b5475399e1b0203f47f1a0` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.261714 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e08d01e55b5475399e1b0203f47f1a0)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:31.263660 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:31.265300 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a992-7b53-4753-84c2-cc73f8d8ccf7 service cinder] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:31.270904 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:31.271702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.272091 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.272492 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] PATH_INFO: `/v3/users/ab6eef0c244147d39345198595406b00` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.274451 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6eef0c244147d39345198595406b00)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:31.276909 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:31.412273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e08d01e55b5475399e1b0203f47f1a0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.412873 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e08d01e55b5475399e1b0203f47f1a0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.421267 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e08d01e55b5475399e1b0203f47f1a0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.433773 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6eef0c244147d39345198595406b00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.434246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e08d01e55b5475399e1b0203f47f1a0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.441191 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6eef0c244147d39345198595406b00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.441881 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6eef0c244147d39345198595406b00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.455878 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6eef0c244147d39345198595406b00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.456636 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-5c83d15f-82df-4930-a7b0-6bf7f11804af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6eef0c244147d39345198595406b00'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.487364 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-f2da0370-d667-4350-bd5d-4eb7507acaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e08d01e55b5475399e1b0203f47f1a0'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:31.496950 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1405/2836] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:31 2022] DELETE /identity/v3/users/5e08d01e55b5475399e1b0203f47f1a0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:31.498505 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.498814 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.499094 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.518134 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:31.519365 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:31.552098 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:31.556906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1432/2837] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:31 2022] DELETE /identity/v3/users/ab6eef0c244147d39345198595406b00 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:44:31.561518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.561803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.562079 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.580286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1406/2838] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:31.580869 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:31.582786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:31.597455 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:31.599007 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:31.649897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1433/2839] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:31.659404 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:31.660226 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f52470-093f-4345-bba6-4d3cb81cd4c8 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:31.715005 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:31.715643 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.715929 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.716204 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.716829 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43523e1f-cbfd-4f86-8d1a-f690635bb3b5 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:31.720440 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:31.721045 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:31.721328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:31.721597 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:31.725531 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:31.728239 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:31.733624 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:31.735139 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:31.740621 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1407/2840] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:31.746225 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1434/2841] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:44:32.286402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:32.292507 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:32.312148 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1a8a-2bf6-45a6-a33f-4cbff98a372b service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:32.317534 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:32.321186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.321186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.321186 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] PATH_INFO: `/v3/projects/1043678d40a14b93bfe03de5e9f9a411` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.322852 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1043678d40a14b93bfe03de5e9f9a411)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:32.323964 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:32.325543 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:32.330636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:32.339577 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:32.345122 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e226d3-4138-4461-9816-da11bd25d847 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:32.350299 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:32.350943 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.352057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.352057 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] PATH_INFO: `/v3/projects/be6b2e8815d64629b6b6b77f6aea817a` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.353897 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6b2e8815d64629b6b6b77f6aea817a)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:32.359017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:32.472249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1043678d40a14b93bfe03de5e9f9a411', 'request_id': 'req-ecd2b589-34a8-4517-a090-5857f98ab480'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.478581 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1043678d40a14b93bfe03de5e9f9a411', 'request_id': 'req-ecd2b589-34a8-4517-a090-5857f98ab480'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.482851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6b2e8815d64629b6b6b77f6aea817a', 'request_id': 'req-4a74d106-add0-41d9-8b8e-188f0d0abdcc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.488179 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6b2e8815d64629b6b6b77f6aea817a', 'request_id': 'req-4a74d106-add0-41d9-8b8e-188f0d0abdcc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.539891 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1043678d40a14b93bfe03de5e9f9a411', 'request_id': 'req-ecd2b589-34a8-4517-a090-5857f98ab480'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.552292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] The token cache is being invalidate because project 1043678d40a14b93bfe03de5e9f9a411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:32.552585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.553315 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-ecd2b589-34a8-4517-a090-5857f98ab480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.554897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1408/2842] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:32 2022] DELETE /identity/v3/projects/1043678d40a14b93bfe03de5e9f9a411 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:32.608676 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6b2e8815d64629b6b6b77f6aea817a', 'request_id': 'req-4a74d106-add0-41d9-8b8e-188f0d0abdcc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.623193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] The token cache is being invalidate because project be6b2e8815d64629b6b6b77f6aea817a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:32.623613 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.624226 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-4a74d106-add0-41d9-8b8e-188f0d0abdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:32.625772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1435/2843] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:32 2022] DELETE /identity/v3/projects/be6b2e8815d64629b6b6b77f6aea817a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:32.631650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.631924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.632200 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.654410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:32.655694 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:32.670222 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:32.725051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1409/2844] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:32.735438 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937152-f75f-419f-a444-bbde0c604941 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.735882 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937152-f75f-419f-a444-bbde0c604941 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.736107 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937152-f75f-419f-a444-bbde0c604941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.757733 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-52937152-f75f-419f-a444-bbde0c604941 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:32.759538 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-52937152-f75f-419f-a444-bbde0c604941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:32.767900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1436/2845] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:32.772993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:32.783225 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fac5f-045d-4934-8f47-61573f60cf69 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:32.788082 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:32.788713 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.788999 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.789280 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.790003 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:32.790303 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:32.792178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:32.804885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1410/2846] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:44:32.810176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937152-f75f-419f-a444-bbde0c604941 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:32.819902 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937152-f75f-419f-a444-bbde0c604941 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:32.825838 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:32.826495 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.827548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.827548 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.827793 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:32.829753 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:32.918386 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1437/2847] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:32 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:32.922561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:32.933405 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36188-bff2-45ad-bcd7-1581b9afc396 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:32.991684 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:32.992371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:32.992659 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:32.992939 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:32.994184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:32.996260 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:33.106206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1411/2848] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:32 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:44:33.110165 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:33.120931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2040a11-308e-4a7e-8b47-7b7ff50cdcde admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:33.126494 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:33.127096 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:33.127373 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:33.127691 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:33.128336 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:33.129975 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:33.143356 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1438/2849] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:33.148379 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:33.158519 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea8b84-9196-4525-adaf-e0341740985c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:33.163127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:33.163755 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:33.164037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:33.164314 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:33.164955 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:33.167223 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab1d98-3302-41ad-b3fc-554fdccd2b2b admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:33.179609 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1412/2850] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:33.186176 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:33.196277 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622383-23a3-46d2-b59d-55f1fe14a8b2 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:33.200918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:33.201600 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:33.201885 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:33.202166 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] PATH_INFO: `/v3/projects/a58630477f374a4e9ecc796d3e06a9d2/users/e4d5b94b2d604aabbe3072bffbbb4b12/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:33.217786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58630477f374a4e9ecc796d3e06a9d2, user_id=e4d5b94b2d604aabbe3072bffbbb4b12, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:33.220488 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:33.305672 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1439/2851] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:33 2022] PUT /identity/v3/projects/a58630477f374a4e9ecc796d3e06a9d2/users/e4d5b94b2d604aabbe3072bffbbb4b12/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:33.316649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:33.316930 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:33.317235 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:33.346520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] MFA Rules not processed for user `e4d5b94b2d604aabbe3072bffbbb4b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:33.347841 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:33.413897 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1413/2852] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:33.426589 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:33.428422 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:33.486118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7d22-86b3-47ea-b3b7-6db5acabf751 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:33.489851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d6b286abb74772860b17905c9fa3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:33.490380 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:33.490658 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:33.490929 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:33.499680 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:33.501095 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a62d8-e1b0-48b6-823b-ed343b730586 service glance] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:33.509976 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1440/2853] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:43.411093 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:43.505962 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:50.740933 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:50.742393 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:50.872453 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d396f5-e55d-4ffe-8b75-bbb329c4b57f None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:50.877653 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:50.878283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:50.878566 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:50.878839 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] PATH_INFO: `/v3/users/c24d3893b0ea41528ac40df80e377b98` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:50.879998 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24d3893b0ea41528ac40df80e377b98)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:50.881909 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:51.096288 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24d3893b0ea41528ac40df80e377b98'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:51.096946 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24d3893b0ea41528ac40df80e377b98'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:51.104953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24d3893b0ea41528ac40df80e377b98'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:51.117382 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24d3893b0ea41528ac40df80e377b98'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:51.258650 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24d3893b0ea41528ac40df80e377b98'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:51.266012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1414/2854] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:44:50 2022] DELETE /identity/v3/users/c24d3893b0ea41528ac40df80e377b98 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:51.271003 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:51.271471 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:51.271697 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:51.299705 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:51.300926 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:51.362456 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1441/2855] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:51.372276 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:51.374790 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:51.395924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:51.454558 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed106-e8c6-45e5-a1ca-5887336ca18e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:51.459026 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:51.459700 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:51.460065 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:51.460582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:51.470649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:51.472140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bc16a-3c89-4149-b91e-b3872a8afa41 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:51.481916 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1415/2856] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:44:51.945549 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:51.946963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:51.959818 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee392cd-c36c-4e53-9af0-37218586ab04 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:51.965193 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:51.965939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:51.966224 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:51.966501 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] PATH_INFO: `/v3/projects/0f8b0471b8be40339ab718e1e153274e` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:51.969255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8b0471b8be40339ab718e1e153274e)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:51.971073 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.048850 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8b0471b8be40339ab718e1e153274e', 'request_id': 'req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:52.057614 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8b0471b8be40339ab718e1e153274e', 'request_id': 'req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:52.115706 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8b0471b8be40339ab718e1e153274e', 'request_id': 'req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:52.126970 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] The token cache is being invalidate because project 0f8b0471b8be40339ab718e1e153274e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:44:52.127259 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:52.127938 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-ec9f113c-bc7e-48f8-b0cd-1f263aac03d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:44:52.129411 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1442/2857] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:44:51 2022] DELETE /identity/v3/projects/0f8b0471b8be40339ab718e1e153274e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:52.134494 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.134953 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.135077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.184228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:52.185426 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:52.243263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1416/2858] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:44:52.251035 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.251348 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.251649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.272071 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:52.273270 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:52.281984 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1443/2859] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:52.286029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.295921 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cf98-03ca-424b-a24c-18f30a93b391 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.300583 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.301184 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.301468 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.301744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.302396 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:44:52.302707 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.304394 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.316296 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1417/2860] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:44:52.320114 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.329809 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be908-96cb-40a9-886a-af0a5f5d186b None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.334830 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.335432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.335849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.336133 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.336772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.338696 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.426069 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1444/2861] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:44:52 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:52.430249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.440552 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894516a4-9c6e-4f62-8400-7ba4968d3e5e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.497636 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.499031 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.499511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.499799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.500446 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.502350 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.573686 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:52.583427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1418/2862] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:44:52 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:44:52.584685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.597650 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b443f-4aea-4ce1-a036-9f92279e68dd admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.602520 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.603128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.603414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.603750 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.604395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.606036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.618861 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1445/2863] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:52.621495 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.633018 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad3b4-179d-40b4-b378-f5823d8a1ca3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.638165 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.639612 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.639991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.640526 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.640979 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.643511 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba1177-8428-4281-9214-413034b7d35c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.659473 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1419/2864] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:44:52.660744 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.671811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6724af3-cf10-436e-8d4a-5ba2a61ed040 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.677295 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.677990 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.678274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.678550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] PATH_INFO: `/v3/projects/f0c1e1281206435e80c395a0904064aa/users/d33f7dd23ef147b9b26def280e24b78f/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.694621 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c1e1281206435e80c395a0904064aa, user_id=d33f7dd23ef147b9b26def280e24b78f, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:52.697349 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:52.813526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1446/2865] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:44:52 2022] PUT /identity/v3/projects/f0c1e1281206435e80c395a0904064aa/users/d33f7dd23ef147b9b26def280e24b78f/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:44:52.825048 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:52.825371 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:52.825655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:52.854023 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] MFA Rules not processed for user `d33f7dd23ef147b9b26def280e24b78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:44:52.855244 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:52.921193 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1420/2866] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:44:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:44:52.931986 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:44:52.933677 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:44:52.949746 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:52.993524 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282964e2-2eb1-4414-8ce5-5ad4214a41eb admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:44:52.998528 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ecf96598f034c928195d02f98059469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:44:52.998992 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:44:53.000849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:44:53.000849 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:44:53.008214 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:44:53.009723 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770764-dd45-4596-8d31-8c6079cd4c74 service cinder] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:44:53.018464 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1447/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:44:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:00.984949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:00.988961 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:01.054124 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008175e-9486-4c71-ae2e-3583060cc3d1 None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:01.058750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:01.059374 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:01.059685 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:01.059962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] PATH_INFO: `/v3/users/e4d5b94b2d604aabbe3072bffbbb4b12` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:01.061283 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d5b94b2d604aabbe3072bffbbb4b12)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:01.063252 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:01.260001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d5b94b2d604aabbe3072bffbbb4b12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:01.260800 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d5b94b2d604aabbe3072bffbbb4b12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:01.268402 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d5b94b2d604aabbe3072bffbbb4b12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:01.281543 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d5b94b2d604aabbe3072bffbbb4b12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:01.285188 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:01.344076 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d5b94b2d604aabbe3072bffbbb4b12'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:01.350726 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1421/2868] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:45:00 2022] DELETE /identity/v3/users/e4d5b94b2d604aabbe3072bffbbb4b12 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:01.355251 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:01.355781 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:01.355896 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:01.375267 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:01.376581 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:01.436925 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1448/2869] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:01.446701 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:01.448106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:01.528761 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3fee7-f161-4da9-8fcc-671a03e1fc9e admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:01.532401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:01.532996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:01.533274 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:01.533544 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:01.542784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:01.544249 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f06fd-ca87-4cf8-9395-29e7838fb126 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:01.553760 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1422/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:01.958460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:01.960081 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:01.982465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ba3ce-2ab1-47a0-a4bf-600a3c3778b7 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:01.982465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:01.982465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:01.982465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:01.982946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] PATH_INFO: `/v3/projects/a58630477f374a4e9ecc796d3e06a9d2` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:01.982946 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58630477f374a4e9ecc796d3e06a9d2)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:01.985084 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.081674 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58630477f374a4e9ecc796d3e06a9d2', 'request_id': 'req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:02.088886 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58630477f374a4e9ecc796d3e06a9d2', 'request_id': 'req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:02.173154 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58630477f374a4e9ecc796d3e06a9d2', 'request_id': 'req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:02.185465 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] The token cache is being invalidate because project a58630477f374a4e9ecc796d3e06a9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:45:02.187216 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:02.187960 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-f8e6cd36-490f-4b9b-808a-06b4f8b9c631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:02.189497 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1449/2871] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:45:01 2022] DELETE /identity/v3/projects/a58630477f374a4e9ecc796d3e06a9d2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:02.194502 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.194990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.195191 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.216140 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:02.217962 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:02.287072 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1423/2872] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:02.295194 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.295470 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.295772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.318615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:02.319848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:02.329603 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1450/2873] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:02.337057 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.347854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0782a5-14ad-4d51-963f-039835008f5a None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.352467 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.353077 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.353389 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.353665 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.354423 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:45:02.354924 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.357058 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.370508 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1424/2874] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 16:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:45:02.376068 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.386615 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7976-9e35-43a3-8eb5-a0b1aad5bfcf None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.392345 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.392953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.393245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.393526 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.394162 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.396370 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.479424 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1451/2875] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:45:02 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:45:02.483735 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.495129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fd02d-cf0f-4171-98d0-3d5c4058cc8f admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.568159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.568842 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.569067 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.569344 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.569990 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.572041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.586614 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:02.653758 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1425/2876] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:45:02 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:45:02.658626 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.669280 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67221d3-9c03-49e2-981a-30a65b944c8e admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.687316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.687316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.687316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.687316 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.687761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.687761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.687761 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:02.692395 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1452/2877] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:45:02.694054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.704585 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d4a7-66d9-4ccb-ad4d-b8ba62a7def4 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.709246 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.709870 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.710159 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.710441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.711088 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.712744 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb30b-5022-4dae-b0c1-4093148fa120 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.724108 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1426/2878] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:45:02.728274 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.738791 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371aec5-fa16-4e95-9d89-09ceea4bb46c admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:02.743518 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:02.744167 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] REQUEST_METHOD: `PUT` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.744448 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.744722 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] PATH_INFO: `/v3/projects/f8cb8cae3c9d459fba5af6ed56c11761/users/471aad74f00c41ee85f4da9beb4c747d/roles/e8186d7e8f8445e18478415ad03750a0` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.759906 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cb8cae3c9d459fba5af6ed56c11761, user_id=471aad74f00c41ee85f4da9beb4c747d, role_id=e8186d7e8f8445e18478415ad03750a0)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:02.762506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:02.833808 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1453/2879] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:45:02 2022] PUT /identity/v3/projects/f8cb8cae3c9d459fba5af6ed56c11761/users/471aad74f00c41ee85f4da9beb4c747d/roles/e8186d7e8f8445e18478415ad03750a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:02.851644 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:02.851937 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:02.852212 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:02.870996 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:02.872230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:02.933292 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1427/2880] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:45:02.944879 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:02.946594 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:03.004582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3fb84-292e-49cb-84c3-4aebea5758df admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:03.008360 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:03.008968 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:03.009254 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:03.009533 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:03.019308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:03.021036 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebf94-bb48-4517-9a97-0d6449c9aa9e service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:03.030593 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1454/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:45:04.443524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:04.445655 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:04.461116 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf403-3a54-4833-bb58-31941111e2dd None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:04.469881 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:04.471746 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:04.472243 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:04.473631 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] PATH_INFO: `/v3/users/d33f7dd23ef147b9b26def280e24b78f` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:04.476230 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33f7dd23ef147b9b26def280e24b78f)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:04.479434 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:04.690762 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33f7dd23ef147b9b26def280e24b78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:04.691638 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33f7dd23ef147b9b26def280e24b78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:04.699823 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33f7dd23ef147b9b26def280e24b78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:04.714788 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33f7dd23ef147b9b26def280e24b78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:04.767674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33f7dd23ef147b9b26def280e24b78f'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:04.775900 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1428/2882] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:45:04 2022] DELETE /identity/v3/users/d33f7dd23ef147b9b26def280e24b78f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:04.780870 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:04.781428 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:04.781527 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:04.803257 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] MFA Rules not processed for user `caf63f3d1ac541d4a3b8a169250bb417`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:04.805434 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:04.871063 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1455/2883] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:45:04.881722 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:04.883174 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:04.946613 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c227-435f-4e68-a89d-8388dae4b839 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:04.950822 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:04.951450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:04.951799 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:04.953520 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:04.961902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:04.963341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7180-b0ed-4854-a051-28ac2f3fbc4c service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:04.969206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:04.974784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1429/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:05.462130 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:05.463832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:05.494713 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c2b4-bc1d-4457-bacf-4766729f4cc6 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:05.504108 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:05.505067 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:05.505413 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:05.505702 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] PATH_INFO: `/v3/projects/f0c1e1281206435e80c395a0904064aa` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:05.507087 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c1e1281206435e80c395a0904064aa)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:05.509080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:05.623893 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c1e1281206435e80c395a0904064aa', 'request_id': 'req-37a1ccbc-b6f3-4086-8018-71003012e2ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:05.632586 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c1e1281206435e80c395a0904064aa', 'request_id': 'req-37a1ccbc-b6f3-4086-8018-71003012e2ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:05.693189 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c1e1281206435e80c395a0904064aa', 'request_id': 'req-37a1ccbc-b6f3-4086-8018-71003012e2ca'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:05.706028 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] The token cache is being invalidate because project f0c1e1281206435e80c395a0904064aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:45:05.706477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:05.707244 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:45:05.708953 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1456/2885] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:45:05 2022] DELETE /identity/v3/projects/f0c1e1281206435e80c395a0904064aa => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:08.577596 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:08.578083 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:08.578197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:08.609885 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.auth.core [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] MFA Rules not processed for user `471aad74f00c41ee85f4da9beb4c747d`. Rule list: `[]` (Enabled: `True`). {{(pid=81804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:08.611269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:08.684603 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1430/2886] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:08.693832 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:08.695308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:08.702085 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:08.766128 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ccbc-b6f3-4086-8018-71003012e2ca admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:08.771056 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:08.771803 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:08.772080 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:08.772563 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:08.773375 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:08.775800 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:08.877297 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1457/2887] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 16:45:08 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:45:08.881228 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:08.892854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68bacc-d92a-42a3-bb05-f6909f3c733b None None] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:08.950263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:08.951372 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] REQUEST_METHOD: `POST` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:08.951683 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:08.951956 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] PATH_INFO: `/v3/users` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:08.952582 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:08.954482 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:09.081949 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1431/2888] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 16:45:08 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:45:09.085871 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:09.096171 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3069-9e12-4e9e-ac9a-724410929f99 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:09.100770 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:09.101362 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:09.101643 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:09.101915 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:09.102559 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:09.104298 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:09.114939 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1458/2889] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:45:09.120152 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:09.131649 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70747d-a558-437a-8f9a-1722fd337551 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:09.136784 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:09.137457 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:09.137740 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:09.138016 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] PATH_INFO: `/v3/projects/3e42638df56746cba472f57ed039d6fe/users/3bccf5969f9d4efd8504c09b9d1116ad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:09.154461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e42638df56746cba472f57ed039d6fe, user_id=3bccf5969f9d4efd8504c09b9d1116ad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:09.157181 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:09.236854 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1432/2890] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:45:09 2022] PUT /identity/v3/projects/3e42638df56746cba472f57ed039d6fe/users/3bccf5969f9d4efd8504c09b9d1116ad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:09.246862 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:09.261017 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5992-a44d-4860-82ed-9e8412f2b568 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:09.331617 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:09.332245 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:09.332530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:09.332811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:09.333477 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:09.335102 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf963e0-203b-4caf-b2f4-a777e9c075b0 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:09.347775 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1459/2891] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:45:09.349944 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:09.361859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282890-aefd-4e3d-a244-636a82f18f42 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:09.367220 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:09.368178 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:09.368327 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:09.368605 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] PATH_INFO: `/v3/projects/3e42638df56746cba472f57ed039d6fe/users/3bccf5969f9d4efd8504c09b9d1116ad/roles/80a461100b904c7e8f047066bc70bf3b` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:09.370878 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e42638df56746cba472f57ed039d6fe, user_id=3bccf5969f9d4efd8504c09b9d1116ad, role_id=80a461100b904c7e8f047066bc70bf3b)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:09.374360 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:09.388768 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1433/2892] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 16:45:09 2022] PUT /identity/v3/projects/3e42638df56746cba472f57ed039d6fe/users/3bccf5969f9d4efd8504c09b9d1116ad/roles/80a461100b904c7e8f047066bc70bf3b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:45:14.737550 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adaba9-d3a4-41ef-a88b-fc8257cde1a2 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:14.738022 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adaba9-d3a4-41ef-a88b-fc8257cde1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:14.738121 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adaba9-d3a4-41ef-a88b-fc8257cde1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:14.770272 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-09adaba9-d3a4-41ef-a88b-fc8257cde1a2 None None] MFA Rules not processed for user `3bccf5969f9d4efd8504c09b9d1116ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:14.771532 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-09adaba9-d3a4-41ef-a88b-fc8257cde1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:14.839025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:14.845018 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1460/2893] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:14.861590 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:14.863551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:14.913173 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:14.968251 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bbbd-3ccc-4d2b-a976-692c41f293f3 admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:14.973880 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:14.974427 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:14.974711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:14.974994 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:15.033258 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:15.034844 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:15.043537 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1434/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:17.775506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] REQUEST_METHOD: `POST` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:17.776082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:17.776082 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:17.797205 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.auth.core [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] MFA Rules not processed for user `471aad74f00c41ee85f4da9beb4c747d`. Rule list: `[]` (Enabled: `True`). {{(pid=81805) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:45:17.798430 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:17.805963 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1461/2895] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:45:25.039565 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=49 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:27.792178 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=4 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:33.652206 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:33.653633 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:33.742361 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0677-d478-44f7-b447-3b3f72a2576d service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:33.747369 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:33.748002 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:33.748287 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:33.748562 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:33.750286 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:33.762089 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:33.763692 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:33.774548 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1435/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:43.051772 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:45:43.053266 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:45:43.110476 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae8642-71cd-438e-9042-cf4e56407554 None None] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:45:43.114390 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:45:43.115011 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:45:43.115310 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:45:43.115698 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:45:43.125439 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:45:43.126908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:45:43.137421 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1462/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:45:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:45:43.769433 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=41 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:53.132945 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=26 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:47:35.834127 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:35.843690 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ef01-a942-4ae1-9aef-0f08000e1a39 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:35.847352 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:35.847982 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:35.848266 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:35.851802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:35.851802 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:35.865624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:35.867041 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:35.879096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1436/2898] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:37.063118 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:37.072308 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69bb7f-4020-45d8-9bba-9dfa6b242286 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:37.075918 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:37.076506 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:37.076786 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:37.077058 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:37.078734 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:37.092804 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:37.094284 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:37.105685 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1463/2899] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:43.885623 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:43.894514 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa1e3b-403e-48cb-ad30-74d4d18f82b6 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:43.898123 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:43.898709 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:43.898991 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:43.899263 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:43.901054 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:43.910310 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:43.911750 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:43.920238 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1437/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:47:47.100268 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:47:49.566666 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:49.568200 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:49.580159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37d33-4379-4b44-80a0-d269aa4da9c7 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:49.583922 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:49.584530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:49.584815 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:49.585094 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:49.586826 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:49.597649 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:49.599101 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:49.607582 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1464/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:49.684992 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:49.693859 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc104bd-6804-40a5-93cc-8cd3f789ac9a service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:49.697456 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bef4155d39e4781b8b4e3cba14a5a80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:49.698674 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:49.699037 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:49.699341 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:49.701096 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:49.714330 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:49.715769 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:49.726461 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1438/2902] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:49.787309 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:49.788745 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:49.803472 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bf27e-f829-4832-90a7-d8f248b57357 service neutron] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:49.809255 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:49.809851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:49.810136 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:49.810414 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:49.812127 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:49.823942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:49.825460 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:49.835209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1465/2903] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:51.484902 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:47:51.496448 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489ec0f-4519-46f9-a694-03670ae08766 service neutron] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:47:51.502441 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:47:51.503051 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:47:51.503334 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:47:51.503648 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:47:51.505450 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:47:51.519993 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:47:51.521569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:47:51.533106 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1439/2904] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:47:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:47:59.830982 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=12 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:48:01.528624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=24 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:49:08.317673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:08.317673 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:08.335088 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf5e3-2903-4342-b3ef-2a39c2177a94 service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:08.342752 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91692048695d4f96ad3ef501c8863b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:08.343684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:08.343684 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:08.343989 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:08.346942 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:08.364811 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:08.365969 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:08.378648 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1466/2905] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:49:16.881551 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:16.895113 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c7e5-2436-44e9-986b-0e3410e604d1 service nova] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:16.900524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:16.901129 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:16.901410 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:16.901827 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:16.903687 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:16.916401 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:16.918029 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:16.928442 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1440/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:49:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:49:18.374530 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=6 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:49:20.539432 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:20.553857 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff3c4-8814-4718-9766-6cfb7b75be23 service nova] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:20.558037 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:20.558659 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] REQUEST_METHOD: `GET` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:20.558930 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:20.559221 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:20.561064 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:20.573296 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:20.575047 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:20.586343 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1467/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:49:20.661732 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:20.724798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9f1d-0346-4192-a452-8d22526ecdd5 service placement] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:20.729430 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:20.730060 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:20.730345 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:20.730624 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] PATH_INFO: `/v3/users/471aad74f00c41ee85f4da9beb4c747d` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:20.731781 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] RBAC: Authorizing `identity:delete_user(user_id=471aad74f00c41ee85f4da9beb4c747d)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:20.734513 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:20.915413 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471aad74f00c41ee85f4da9beb4c747d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:20.916128 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471aad74f00c41ee85f4da9beb4c747d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:20.923711 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471aad74f00c41ee85f4da9beb4c747d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:20.935470 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471aad74f00c41ee85f4da9beb4c747d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.021137 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471aad74f00c41ee85f4da9beb4c747d'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.027203 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1441/2908] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:49:20 2022] DELETE /identity/v3/users/471aad74f00c41ee85f4da9beb4c747d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:49:21.274876 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:21.287792 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9246-78e1-4484-b0b4-33737b077c9c service placement] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:21.345426 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:21.346138 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:21.346433 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:21.346716 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] PATH_INFO: `/v3/projects/f8cb8cae3c9d459fba5af6ed56c11761` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:21.347931 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cb8cae3c9d459fba5af6ed56c11761)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:21.349900 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:21.452240 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cb8cae3c9d459fba5af6ed56c11761', 'request_id': 'req-54c2913a-3dec-4059-83e5-f22c63c37d96'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.458209 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cb8cae3c9d459fba5af6ed56c11761', 'request_id': 'req-54c2913a-3dec-4059-83e5-f22c63c37d96'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.507361 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cb8cae3c9d459fba5af6ed56c11761', 'request_id': 'req-54c2913a-3dec-4059-83e5-f22c63c37d96'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.520041 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] The token cache is being invalidate because project f8cb8cae3c9d459fba5af6ed56c11761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:49:21.520328 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.520954 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.522512 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1468/2909] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:49:21 2022] DELETE /identity/v3/projects/f8cb8cae3c9d459fba5af6ed56c11761 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:49:21.526524 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:21.528001 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:21.541012 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ed-40bf-4dc6-b87f-5fa4a978751c admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:21.598273 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:21.598912 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:21.599197 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:21.599477 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] PATH_INFO: `/v3/users/3bccf5969f9d4efd8504c09b9d1116ad` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:21.600773 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bccf5969f9d4efd8504c09b9d1116ad)` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:21.602693 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:21.608346 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:49:21.794569 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bccf5969f9d4efd8504c09b9d1116ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.795724 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bccf5969f9d4efd8504c09b9d1116ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.802561 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bccf5969f9d4efd8504c09b9d1116ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.815767 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bccf5969f9d4efd8504c09b9d1116ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.890608 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.notifications [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bccf5969f9d4efd8504c09b9d1116ad'} {{(pid=81804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:21.896619 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1442/2910] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 16:49:21 2022] DELETE /identity/v3/users/3bccf5969f9d4efd8504c09b9d1116ad => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:49:22.149051 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Authenticating user token {{(pid=81805) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:49:22.150511 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.fernet_utils [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81805) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:49:22.164908 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2913a-3dec-4059-83e5-f22c63c37d96 admin admin] Validating token access rules against request {{(pid=81805) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:49:22.230890 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf63f3d1ac541d4a3b8a169250bb417', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd82f5f177bcb4be880a31087244a29b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81805) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:49:22.231539 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:49:22.231824 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:49:22.232100 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] PATH_INFO: `/v3/projects/3e42638df56746cba472f57ed039d6fe` {{(pid=81805) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:49:22.233866 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e42638df56746cba472f57ed039d6fe)` {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:49:22.235797 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] RBAC: Authorization granted {{(pid=81805) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:49:22.255851 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:49:22.387846 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e42638df56746cba472f57ed039d6fe', 'request_id': 'req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:22.399529 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e42638df56746cba472f57ed039d6fe', 'request_id': 'req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:22.472848 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e42638df56746cba472f57ed039d6fe', 'request_id': 'req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc'} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:22.485159 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] The token cache is being invalidate because project 3e42638df56746cba472f57ed039d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81805) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:49:22.488025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:22.488025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG keystone.notifications [None req-da3d2f49-3f78-4196-a1bf-aa5b20f337cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81805) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:49:22.488025 dv-cinder-831247-23-smb devstack@keystone.service[81805]: [pid: 81805|app: 0|req: 1469/2911] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 16:49:22 2022] DELETE /identity/v3/projects/3e42638df56746cba472f57ed039d6fe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:49:31.893068 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:49:32.481419 dv-cinder-831247-23-smb devstack@keystone.service[81805]: DEBUG dbcounter [-] [81805] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:50:50.104399 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Authenticating user token {{(pid=81804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:50:50.105798 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:50:50.174354 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3056-5d6c-4481-9a61-39529f94fcad admin admin] Validating token access rules against request {{(pid=81804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:50:50.232741 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a7176bf626d4d8283c13da32f788c82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d0d36cf34b24e869bf86aff69c48d30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:50:50.233347 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] REQUEST_METHOD: `GET` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:50:50.233629 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] SCRIPT_NAME: `/identity` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:50:50.233904 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:50:50.236269 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.fernet_utils [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:50:50.247359 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:50:50.248959 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c880-39d5-4688-9171-8949cc6064ba service placement] RBAC: Authorization granted {{(pid=81804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:50:50.259599 dv-cinder-831247-23-smb devstack@keystone.service[81804]: [pid: 81804|app: 0|req: 1443/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:51:00.255305 dv-cinder-831247-23-smb devstack@keystone.service[81804]: DEBUG dbcounter [-] [81804] Writing DB stats keystone:SELECT=58 {{(pid=81804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}